Should we ask for rent back since we aren't living there?

Yes you should ask for the money back and do not pay any rent until you move back in and that month's rent should be pro-rated. So you take your rent divided by the number of days in the month, then multiply by the number of days you were unable to live in the unit. This should all be in the lease, put your request in writing, certified mail. If landlord give you a hard time go to landlord and tenants court.