Well, headless running isn’t an area of expertise for me, but IBC and Gateway certainly seem to be running ok. ? The only thing I can think of is that maybe you should add: ? export DISPLAY=:0 ? after the xvfb command. ? By the way, I’m curious that your logfile contains a lot of lines from the Gateway logfile. Did you edit them in? If not, how did they get there? In general it’s very rare that there’s any value in the Gateway/TWS logfiles for diagnosing IBC issues. ? Richard ? ? ? ?
|
Here is a screen shot of my Vnc client being closed ...
|
Please find attached my logfile ....
Qn: Should I be suing X11 forwarding with Putty instead of using a vnc server?
Thanks in advance
Paul
|
Re: Problem witrh Gateway 10.22
Oooops, please disregard my last question. I had a senior moment. Installing xterm (which was apparently not installed on my computer) solved all issues. IBC is now running like a charm.
|
Re: Problem witrh Gateway 10.22
I have installed IBC on my Ubuntu computer, downloaded the newer IBC.jar and version files, and followed the instructions on setting the basic (default) parameters in the config.ini and 1022 version number in gatewaystart.sh and twsstart.sh. Unfortunately does it not start: when executing from a command prompt I get an error message: "line 233: xterm: command not found" I get this for both gatewaystart and twsstart. What am I doing wrong?
|
Re: Problem witrh Gateway 10.22
Thank you. I will do a fresh install of the latest version of IBC and hope that it will cure the Gateway issues I'm seeing recently. Thus far, when I did see that pop-up window asking about re-login, I was not required to provide any credentials. But thanks for warning that this might be necessary on occasion.
|
Re: Problem witrh Gateway 10.22
Yes, IBC will do this. But it may require 2FA again, So you may need to keep your phone (or other device running IBKR Mobile app) handy. ? Richard ? ?
toggle quoted message
Show quoted text
From: [email protected] <[email protected]> On Behalf Of windmill_1965 via groups.io
Sent: Saturday, April 22, 2023 2:47 AM
To: [email protected]
Subject: Re: [ibc] Problem witrh Gateway 10.22? Richard,
I recently upgraded Gateway from 9.81 to 10.22. I am currently not using IBC. However, I notice that 10.22 is more unreliable than its predecessor. I am running Gateway the entire week: starting it on Sunday evening and letting it run to the following Saturday morning. Unfortunately, about three times per week it loses connection, can't reconnect itself and then shows a pop-up window asking me whether I want to re-login. I have attached a screenshot of this pop-up window. Would IBC be able to recognize this pop-up window and push the "Re-login" button?
|
Please reply with the complete logfile – attach it, don’t quote it. ? Richard ? ? ?
toggle quoted message
Show quoted text
From: [email protected] <[email protected]> On Behalf Of PaulMac
Sent: Saturday, April 22, 2023 9:16 AM
To: [email protected]
Subject: [ibc] Gateway crashing? I haven't been able to keep the Gateway running longer than a couple of hours.
It is installed on AWS ubuntu 2GB server Vers 10.21 I need to run? /usr/bin/Xvfb :0 -ac -screen 0 1024x768x24 & //?X11 virtual framebuffer /usr/bin/x11vnc -ncache 10 -ncache_cr -viewpasswd view_only_pwd -passwd full_access_pwd -display :0 -forever -shared -bg -noipv6 //?start the VNC server then run the GW to the X Display DISPLAY=:0 ~/opt/ibc/gatewaystart.sh // run the GW script using Display :0
My logfile contains the following .... 2023-04-20 09:45:00:540 IBC: Saving Tws settings 2023-04-20 09:45:00:540 IBC: Getting main window 2023-04-20 09:45:00:540 IBC: Main window already found 2023-04-20 10:00:00:539 IBC: Saving Tws settings 2023-04-20 10:00:00:539 IBC: Getting main window 2023-04-20 10:00:00:539 IBC: Main window already found 2023-04-20 10:15:00:539 IBC: Saving Tws settings 2023-04-20 10:15:00:539 IBC: Getting main window 2023-04-20 10:15:00:539 IBC: Main window already found ? java: Fatal IO error 11 (Resource temporarily unavailable) on X server :0.
I would like to run the Gateway in a headless form but not possible, need to have a framebuffer unfortuneatly but doesn't work for me
|
I haven't been able to keep the Gateway running longer than a couple of hours. It is installed on AWS ubuntu 2GB server
Vers 10.21
I need to run?
/usr/bin/Xvfb :0 -ac -screen 0 1024x768x24 & //?X11 virtual framebuffer
/usr/bin/x11vnc -ncache 10 -ncache_cr -viewpasswd view_only_pwd -passwd full_access_pwd -display :0 -forever -shared -bg -noipv6 //?start the VNC server
then run the GW to the X Display
DISPLAY=:0 ~/opt/ibc/gatewaystart.sh // run the GW script using Display :0
My logfile contains the following ....
2023-04-20 09:45:00:540 IBC: Saving Tws settings
2023-04-20 09:45:00:540 IBC: Getting main window
2023-04-20 09:45:00:540 IBC: Main window already found
2023-04-20 10:00:00:539 IBC: Saving Tws settings
2023-04-20 10:00:00:539 IBC: Getting main window
2023-04-20 10:00:00:539 IBC: Main window already found
2023-04-20 10:15:00:539 IBC: Saving Tws settings
2023-04-20 10:15:00:539 IBC: Getting main window
2023-04-20 10:15:00:539 IBC: Main window already found
?
java: Fatal IO error 11 (Resource temporarily unavailable) on X server :0.
I would like to run the Gateway in a headless form but not possible, need to have a framebuffer unfortuneatly but doesn't work for me
|
Re: Problem witrh Gateway 10.22
Richard, I recently upgraded Gateway from 9.81 to 10.22. I am currently not using IBC. However, I notice that 10.22 is more unreliable than its predecessor. I am running Gateway the entire week: starting it on Sunday evening and letting it run to the following Saturday morning. Unfortunately, about three times per week it loses connection, can't reconnect itself and then shows a pop-up window asking me whether I want to re-login. I have attached a screenshot of this pop-up window. Would IBC be able to recognize this pop-up window and push the "Re-login" button? 
|
Re: Problem witrh Gateway 10.22
Pranav ? I’ve no idea what went wrong apart from the fact that the relevant jar file didn’t seem to contain the code it should.? Why that should be the case is a mystery to me, unless there was actually something wrong with the installer. ?It’s possible the installer you downloaded was faulty and IB fixed it before I downloaded it. ? So if you actually need 10.22, it would be worth doing it again. Note that you can have any number of Gateway/TWS versions installed – they don’t interfere with each other, so you don’t need to uninstall 10.19 to try 10.22. You only need to change the major version number in the start script (and use the 3.16.3 IBC for 10.22). You could also install 3.16.3 in a different folder from 3.16.2 so if it still doesn’t work it would be easy to revert to 10.19. ? ?
toggle quoted message
Show quoted text
From: [email protected] <[email protected]> On Behalf Of Pranav Lal
Sent: Sunday, April 16, 2023 4:37 AM
To: [email protected]
Subject: Re: [ibc] Problem witrh Gateway 10.22? Hi Richard, ? I have gone back to gateway version 1019.1. I searched for interactive brokers standalone gateway linux 64 installer
And finally to At least as far as I can recall. ? I also reinstalled ibc’s current release without the updated IBC.jar. ? Things are working once again. ? I cannot determine what happened. ? Did the startup scripts mess up the classpath or were things really mixed at my end? ? Pranav
|
Re: Problem witrh Gateway 10.22
Hi Richard, ? I have gone back to gateway version 1019.1. I searched for interactive brokers standalone gateway linux 64 installer And finally to At least as far as I can recall. ? I also reinstalled ibc’s current release without the updated IBC.jar. ? Things are working once again. ? I cannot determine what happened. ? Did the startup scripts mess up the classpath or were things really mixed at my end? ? Pranav
toggle quoted message
Show quoted text
From: [email protected] <[email protected]> On Behalf Of Richard L King
Sent: Saturday, April 15, 2023 11:25 PM
To: [email protected]
Subject: Re: [ibc] Problem witrh Gateway 10.22 ? [Actually the version is still incorrect – it’s not showing any version at all now! The version file should contain just “3.16.3” and nothing else. However, that’s irrelevant as far as your actual problem is concerned.] ? Well, here’s a strange thing, I’ve compared your logfile with mine on Ubuntu 22.04 and they are identical up to the point where yours fails (except for the OS details and the username). Mine carries on fine and loads IBC with no problem. ? I can only conclude that one of your jar files is corrupt – presumably the one that contains the main entrypoint, can’t remember which one that is. Maybe it has somehow lost its manifest? ? As a basic sanity check, if you haven’t already done so, can you try running Gateway directly from the IB-supplied link – ie without using IBC. If that doesn’t work, then you’ll have to uninstall Gateway and reinstall. If it does work, then I’m completely at a loss – so I think I’d still recommend you uninstall and reinstall Gateway. ? ? ? ? ? Hi again Richard, ? Please see the updated log which I have attached. The version seems to be now correct but the problem remains the same. ? Pranav ? ? You should have let the installer install to its default location, which is /home/pranav/Jts/ibgateway/1022 ? This being the case, IBC should find the jars folder at /home/pranav/Jts/ibgateway/1022/jars. If it’s not there, it must be because you didn’t use the installer’s default location. ? If you actually used the TWS installer, the default location would be /home/pranav/Jts/1022, and the jars folder would be at /home/pranav/Jts/1022/jars ? Since IBC isn’t finding the jars folder, either you didn’t install the standalone (offline) version, or you changed the installer’s location from the default. ? By the way, you don’t seem to have successfully deployed the updated IBC.jar and version files, as your logfile still says it’s IBC 3.16.2, not 3.16.3. ? Richard ?
|
Re: Problem witrh Gateway 10.22
[Actually the version is still incorrect – it’s not showing any version at all now! The version file should contain just “3.16.3” and nothing else. However, that’s irrelevant as far as your actual problem is concerned.] ? Well, here’s a strange thing, I’ve compared your logfile with mine on Ubuntu 22.04 and they are identical up to the point where yours fails (except for the OS details and the username). Mine carries on fine and loads IBC with no problem. ? I can only conclude that one of your jar files is corrupt – presumably the one that contains the main entrypoint, can’t remember which one that is. Maybe it has somehow lost its manifest? ? As a basic sanity check, if you haven’t already done so, can you try running Gateway directly from the IB-supplied link – ie without using IBC. If that doesn’t work, then you’ll have to uninstall Gateway and reinstall. If it does work, then I’m completely at a loss – so I think I’d still recommend you uninstall and reinstall Gateway. ? ? ? ?
toggle quoted message
Show quoted text
From: [email protected] <[email protected]> On Behalf Of Pranav Lal
Sent: Saturday, April 15, 2023 12:31 PM
To: [email protected]
Subject: Re: [ibc] Problem witrh Gateway 10.22? Hi again Richard, ? Please see the updated log which I have attached. The version seems to be now correct but the problem remains the same. ? Pranav ? ? You should have let the installer install to its default location, which is /home/pranav/Jts/ibgateway/1022 ? This being the case, IBC should find the jars folder at /home/pranav/Jts/ibgateway/1022/jars. If it’s not there, it must be because you didn’t use the installer’s default location. ? If you actually used the TWS installer, the default location would be /home/pranav/Jts/1022, and the jars folder would be at /home/pranav/Jts/1022/jars ? Since IBC isn’t finding the jars folder, either you didn’t install the standalone (offline) version, or you changed the installer’s location from the default. ? By the way, you don’t seem to have successfully deployed the updated IBC.jar and version files, as your logfile still says it’s IBC 3.16.2, not 3.16.3. ? Richard ?
|
Re: Problem witrh Gateway 10.22
Hi again Richard, ? Please see the updated log which I have attached. The version seems to be now correct but the problem remains the same. ? Pranav ?
toggle quoted message
Show quoted text
From: [email protected] < [email protected]> On Behalf Of Richard L King Sent: Saturday, April 15, 2023 4:15 PM To: [email protected]Subject: Re: [ibc] Problem witrh Gateway 10.22 ? You should have let the installer install to its default location, which is /home/pranav/Jts/ibgateway/1022 ? This being the case, IBC should find the jars folder at /home/pranav/Jts/ibgateway/1022/jars. If it’s not there, it must be because you didn’t use the installer’s default location. ? If you actually used the TWS installer, the default location would be /home/pranav/Jts/1022, and the jars folder would be at /home/pranav/Jts/1022/jars ? Since IBC isn’t finding the jars folder, either you didn’t install the standalone (offline) version, or you changed the installer’s location from the default. ? By the way, you don’t seem to have successfully deployed the updated IBC.jar and version files, as your logfile still says it’s IBC 3.16.2, not 3.16.3. ? Richard ?
|
Re: Problem witrh Gateway 10.22
Hi Richard, ? I did use the offline gateway installer or so I think. Here is what I did. - I went to interactivebrokers.com.
- I then navigate to the “log in” button and activated that submenu.
- I then select gateway from there.
- I then chose Linux 64.
- I finally did a wget ?with the download link.
I do have the jars folder at /home/pranav/Jts/ibgateway/1022/jars ? That folder contains the following items. [pranav@archlinux jars]$ ls -1????????????????????????????????????????????????????????????????????????????????????????? jackson-core-2.12.3.jar????? ??????????????????????????????????????????????????????????????????????????????????????????? jts4launch-1022.jar???????????????????????????????????????????????????????????????????????????????????????????????????? jxbrowser-7.29.jar???????????????????????? ????????????????????????????????????????????????????????????????????????????? jxbrowser-linux64-7.29.jar????????????????????????????????????????????????????????????????????????????????????????????? jxbrowser-swing-7.29.jar???????????????????????????????? ??????????????????????????????????????????????????????????????? locales.jar???????????????????????????????????????????????????????????????????????????????????????????????????????????? log4j-api-2.17.1.jar?????????????????????????????????????????????????? ????????????????????????????????????????????????? log4j-core-2.17.1.jar?????????????????????????????????????????????????????????????????????????????????????????????????? total-2020.jar?????????????????????????????????????????????????????????????????????? ??????????????????????????????????? twslaunch-1022.jar????????????????????????????????????????????????????????????????????????????????????????????????????? twslaunch-install4j-1.12.jar?????????????????????????????????????????????????????????????????????? ????????????????????? ? ? Pranav
toggle quoted message
Show quoted text
From: [email protected] < [email protected]> On Behalf Of Richard L King Sent: Saturday, April 15, 2023 4:15 PM To: [email protected]Subject: Re: [ibc] Problem witrh Gateway 10.22 ? You should have let the installer install to its default location, which is /home/pranav/Jts/ibgateway/1022 ? This being the case, IBC should find the jars folder at /home/pranav/Jts/ibgateway/1022/jars. If it’s not there, it must be because you didn’t use the installer’s default location. ? If you actually used the TWS installer, the default location would be /home/pranav/Jts/1022, and the jars folder would be at /home/pranav/Jts/1022/jars ? Since IBC isn’t finding the jars folder, either you didn’t install the standalone (offline) version, or you changed the installer’s location from the default. ? By the way, you don’t seem to have successfully deployed the updated IBC.jar and version files, as your logfile still says it’s IBC 3.16.2, not 3.16.3. ? Richard ?
|
Re: Problem witrh Gateway 10.22
You should have let the installer install to its default location, which is /home/pranav/Jts/ibgateway/1022 ? This being the case, IBC should find the jars folder at /home/pranav/Jts/ibgateway/1022/jars. If it’s not there, it must be because you didn’t use the installer’s default location. ? If you actually used the TWS installer, the default location would be /home/pranav/Jts/1022, and the jars folder would be at /home/pranav/Jts/1022/jars ? Since IBC isn’t finding the jars folder, either you didn’t install the standalone (offline) version, or you changed the installer’s location from the default. ? By the way, you don’t seem to have successfully deployed the updated IBC.jar and version files, as your logfile still says it’s IBC 3.16.2, not 3.16.3. ? Richard ?
|
Re: Problem witrh Gateway 10.22
Hi Richard and all, ? I upgraded to version 1022 and have updated to the file mentioned in the below message. However, ibc is unable to find the gateway. ? I have installed in the standard path. ? ? I have attached the complete ibc log to this message. Pranav ?
toggle quoted message
Show quoted text
From: [email protected] < [email protected]> On Behalf Of Richard L King Sent: Tuesday, April 11, 2023 2:31 AM To: [email protected]Subject: [ibc] Problem witrh Gateway 10.22 ? [NB: if you are not trying to use Gateway 10.22 there is no need for you to take any action, so just ignore this.] ? It’s come to my attention that IBC 3.16.2 and earlier doesn’t work properly with Gateway 10.22: it fails to fill in the username and password when logging in (but TWS 10.22 is fine). ? This is because of a change to the window title of the login dialog that IB have made: it used to be ‘IB Gateway’ and now it’s ‘IBKR Gateway’. Consequently IBC doesn’t recognise it as the login dialog, and ignores it. ? I have fixed the problem and a new version is accessible on GitHub, but I haven’t actually yet created a new release in the usual way. There are other things that need to go into the next release, and I’m not quite ready for it. ? So in the meantime you can download the new version of the following files from : ? IBC.jar version ? Just download these two files directly and copy them over the current versions in your IBC installation folder. No other changes are necessary. ? After deploying these files, IBC will identify as version 3.16.3 in the logfiles. ? Richard ?
|
Well, I think you really need to fix the problem with TightVNC. I can’t give you any advice about that. ? Other than that, not sure what you can do other than standard Linux commands over SSH. ? Regarding log files, IBC took a silly decision several years ago to encrypt the Gateway and TWS logfiles, as you’ve discovered. The launcher.log file only contains information from the startup phase, so it will never tell you about anything later. And to view the encrypted logfiles you have to use the GUI, which is a bit tricky if your VNC session is inaccessible (you REALLY need to fix that problem…!). ? The only other thing is the IBC logfile, but that won’t tell you much either. Though if IBC has shutdown for some reason, that should be recorded in the logfile. ? Oh, there is one other possibility: you can use IBC’s command sever port (see the settings for this in config.ini) to send a dummy command, say “HELLO”, and you’ll get an ‘ERROR Command invalid’ response if IBC is running. You can send such a command using telnet, for example: ? telnet 10.252.0.7 7462 ? Here 10.252.0.7 is the IP address of my server running Gateway, and 7462 is the port number configured for the IBC command server. This will start an interactive telnet session if IBC is running, then just type in any command (other than STOP and RESTART which do exactly what they say). ? Alternatively you could script this: ? (echo restart; sleep 1; echo "HELLO" ) | telnet 10.252.0.7 7462 ? Richard
|
I'm attempting to run IBC on AWS lightsail (ubuntu).
I have basically followed the directions from :?
When I connect to my running IBC/GW instance using TightVNC all is good until it isnt. i.e if my computer goes to sleep or restarts I can't get back in to see what is going on
My question is how do I know if my GW is still running when my viewing terminal is lost, i.e my client (local computer) has an evernt, (like it goes to sleep or something worse)
I can't seem to get any information out the /Jts/launcher.log file. The last line useful is always?
2023-04-13 08:25:34.309 [AG] INFO? [JTS-PostAuthenticateS2-24] - Switching to a new encrypted log...
And then I don't see any logging info
|
Problem witrh Gateway 10.22
[NB: if you are not trying to use Gateway 10.22 there is no need for you to take any action, so just ignore this.] ? It’s come to my attention that IBC 3.16.2 and earlier doesn’t work properly with Gateway 10.22: it fails to fill in the username and password when logging in (but TWS 10.22 is fine). ? This is because of a change to the window title of the login dialog that IB have made: it used to be ‘IB Gateway’ and now it’s ‘IBKR Gateway’. Consequently IBC doesn’t recognise it as the login dialog, and ignores it. ? I have fixed the problem and a new version is accessible on GitHub, but I haven’t actually yet created a new release in the usual way. There are other things that need to go into the next release, and I’m not quite ready for it. ? So in the meantime you can download the new version of the following files from : ? IBC.jar version ? Just download these two files directly and copy them over the current versions in your IBC installation folder. No other changes are necessary. ? After deploying these files, IBC will identify as version 3.16.3 in the logfiles. ? Richard ?
|
Pranav Lal