by Tim Hunt.
Moodle 2.4 is due to be released next Monday, barring something unforseen. https://moodle.org/mod/forum/discuss.php?d=216609
Almost all the QA tests are now passing: http://tracker.moodle.org/secure/Dashboard.jspa?selectPageId=11454
Moodle 2.4 is running fine here.
There is no way to reverse an upgrade, unless you restore a back-up of the site from before the upgrade.
Therefore, I think you should stick with it.
If you do find any bugs, please report them.
By being a (very) early adopter, you are making a valuable contribution to the Moodle project. Thanks!