Downsized my voucher

I had a 3 bdrm voucher, but I had to have a relative move out due to personal issues so they decreased me to a 2 which is fine. Will I have to move immediately or will they give me time because I am currently ill and disabled and I can not get an answer from my case worker. She said being that they did not increase my rent she can’t force me to move but it’s up to the landlord. Any help would be appreciated in pennsylvania