If there ever was such an agreement(apparently oral) between your grandmother
and the land owner, it would never have been enforceable since it would
have been in violation of the Virginia Statute of Frauds codified in Title 11 of the
Va. Code.
Therefore, if the above is correct, you would have no right whatsoever to remain on this property.