It's likely, given what little we have come to learn about physics, that it is only possible to travel forward in time. Even then you're not traveling so much as being in a stasis like state until a point in the future. Of course time is also not uniform in the observable universe so whose to say that our physics are also not uniform.
It also depends on whether you believe in the multiverse theory or not