Does the government really have the right to take my property?
So long as it is for public use, or for a public purpose, yes. However, the government or condemning authority is required to provide you with compensation for the taking and any damage to the remaining property.