Ficus is very touchy and will protest any change of location, exposure, temperature or irrigation by droppings its leaves. Sometimes they're just plain temperamental. All you can do it keep treating it the same in the same place. It will recover in time and sprout new leaves.

~aj
the above based on my experience with the one I've had for the last seven years.