I haven't used the parts of JMRI you are trying to use. But, in general, I'm certain you are trying to accomplish more things with more precision than JMRI was designed for. Your goal seems very ambitious.
Unless you somehow do
an inventory of all the locomotives and cars/wagons at startup, I don't
see how the control program could know where the units are to make up
desired trains, and then to put units/cars/wagons at their desired
locations after their journeys.
Also, to actually work, your trackwork and equipment must be "flawless". Coupling and uncoupling must work every time when intended. Train speeds must be known with high precision and at multiple throttle settings, and with varying loads. Most of us have difficulty accomplishing fault free switching/shunting while observing our trains in real time.
What you are trying to do is something many of us would like. I think you will have a great deal of trouble making it work, and work reliably and faultlessly. Be prepared to lose some sleep getting this working! As for video cameras, couldn't more than one be used? Add another one for each station under the visible portion of the railroad, for example? With internet AI, maybe it would be possible to adjust the program for train characteristics in nearly real time.
Best of luck with this! If you get it to work, it might become a widely useful addition to JMRI.
