You need to check with your local Social Security Office, but I believe they looked at earned income and not passive income, which rental income would be considered. Just do not give them any identifying information and take down the name and ID of the person who answered your question.
