Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VPS Server Is going down randomly.. #3112

Closed
iamdivyanshverma opened this issue Jan 6, 2024 · 17 comments
Closed

VPS Server Is going down randomly.. #3112

iamdivyanshverma opened this issue Jan 6, 2024 · 17 comments

Comments

@iamdivyanshverma
Copy link

Current Behavior

Hi @Ysurac , My VPS Server is going down randomly , In logread it says Can't Get VPS Token . If i tries to login to the is server its not accessable i have to reboot the VPS Server from the console it order to make it work .
Tried with multiple VPS Provider like AWS,Vultur,etc.
Please Let me know if you need more details .
Thanks

Specifications

  • OpenMPTCProuter version: v0.60beta1-6.1
  • OpenMPTCProuter VPS version: OpenMPTCProuter VPS 0.1029-test
  • OpenMPTCProuter VPS provider: AWS/Vultur
  • OpenMPTCProuter platform: RPI4/x86_64
  • Country: India
@Ysurac
Copy link
Owner

Ysurac commented Jan 6, 2024

Your VPS is down and you don't get any connection anymore ? Or only status display problem ? (token is not always updated and should not make major problem after initial configuration)

@iamdivyanshverma
Copy link
Author

yes my VPS is down , i lost connection ...

@Ysurac
Copy link
Owner

Ysurac commented Jan 7, 2024

When you say console, you mean VNC console from the provider ? If not, try it.
Check on console log if there is a kernel panic (or anything strange in dmesg).
If not:

  • check if you can ping outside from the VPS (ping 1.1.1.1 for example)
  • check firewall configuration, shorewall is used by default so check in /etc/shorewall/params.net that the correct interface is indicated (should be the interface used to exit on internet)
  • check in /etc/shorewall/rules that you didn't add any rules that can break access
  • check server uptime, to check if it doesn't reboot or shutdown

What is the OS used on the VPS ? Should be Debian 12 for 6.1 snapshots.

@kmrinal
Copy link

kmrinal commented Jan 7, 2024

@Ysurac The servers actually hangs and there is no way to get inside it (via ssh or via VPS provider's access methods). If we reboot the server, it does come back and behaves normally, until it hangs again after few hours.

The OS is Debian 12.

PS: I work with @iamdivyanshverma

@Ysurac
Copy link
Owner

Ysurac commented Jan 7, 2024

Strange that provider console doesn't work, should give a screen even if it's a kernel crash.
What is the kernel release ? uname -a ?

@kmrinal
Copy link

kmrinal commented Jan 7, 2024

Yeah, it was quite strange that console would not load up.

Uname Info is:

Linux Bonding-Server 6.1.0-17-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.69-1 (2023-12-30) x86_64 GNU/Linux

@Ysurac
Copy link
Owner

Ysurac commented Jan 7, 2024

I'm launching tests on same kernel with latest snapshot script.
What is the proxy and VPN used ? How many connections ? Anything special when you have the crash ? I will try to reproduce it.

@kmrinal
Copy link

kmrinal commented Jan 7, 2024

The VPN is Glorytun TCP and Proxy is Shadowsocks. Its a standard configuration and only one OMR device is connected to the server.

The servers have stopped when in use and also when left idle for sometime. We havent observed any specific pattern for it though.

Thank you Ysurac.

@Ysurac
Copy link
Owner

Ysurac commented Jan 8, 2024

My VPS is still running without crash, do you know how many hours for a crash ?
You have nothing more installed than the VPS script on the server ?

@Ysurac
Copy link
Owner

Ysurac commented Jan 12, 2024

I was able to reproduce the issue.
It was also on 6.1.0-17 kernel (no problem on 6.1.0-13 kernel for now).
I'm now testing with kernel 6.5 on same server: apt-get install linux-image-6.5.0-0.deb12.4-cloud-amd64 linux-headers-6.5.0-0.deb12.4-cloud-amd64

@kmrinal
Copy link

kmrinal commented Jan 12, 2024

Ok, I am glad you were able to reproduce it.

One of the things we noticed that the CPU usage went to 100% and was stuck there until the server was rebooted. Not sure which service/application would cause that. The server does not run anything other than the OMR VPS codebase.

@kmrinal
Copy link

kmrinal commented Feb 2, 2024

@Ysurac Did server performance/stability improve with 6.5 Kernel ?

@Ysurac
Copy link
Owner

Ysurac commented Feb 2, 2024

I didn't have crash on 6.5, you can try to update.

Soon I will add support of kernel 6.6 in VPS script, as I need some features.

@iamdivyanshverma
Copy link
Author

Hi again , looks like we are still having crash in 6.5.0-0.deb12.4-cloud-amd64..

@Ysurac
Copy link
Owner

Ysurac commented Feb 15, 2024

I didn't have any crash on same VM with 6.5 since 33 days.
You can try to follow this guide to enable crash dump: https://www.cyberciti.biz/faq/how-to-on-enable-kernel-crash-dump-on-debian-linux/
This is the only solution I have to get a log that may help to find where is the issue.

@iamdivyanshverma
Copy link
Author

Thanks for the quick reply, i will try this and get back to you if i find something.

Copy link

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants