How do I get out of a Newly singed lease if I haven't moved in yet?

I signed a lease to move into an apartment and paid part of the down payment but haven't moved in yet. But the same day i found a cheaper and bigger place that i love. Does anyone know how i could get out of the lease with minimum loss?