-
Notifications
You must be signed in to change notification settings - Fork 830
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Topic packets from Windows to WSL interface dissappearing (ROS2 app) #11966
Comments
Logs are required for review from WSL teamIf this a feature request, please reply with '/feature'. If this is a question, reply with '/question'. How to collect WSL logsDownload and execute collect-wsl-logs.ps1 in an administrative powershell prompt:
The script will output the path of the log file once done. If this is a networking issue, please use collect-networking-logs.ps1, following the instructions here Once completed please upload the output files to this Github issue. Click here for more info on logging View similar issuesPlease view the issues below to see if they solve your problem, and if the issue describes your problem please consider closing this one and thumbs upping the other issue to help us prioritize it! Open similar issues:
Closed similar issues:
|
Interesting update:
The laptops with expected performance:
Laptop 2
Right now we're considering issues with WSL, Windows 11 and Intel P-E cores as the faulty laptops uses 13th Gen Intel(R) Core(TM) i9-13950HX Not sure if could be connected to #9190 |
thanks for reporting the issue. can you please collecting networking logs using instructions at https://github.com/microsoft/WSL/blob/master/CONTRIBUTING.md#collect-wsl-logs-for-networking-issues the script will generate a zip with name starting with "WslNetworkingLogs" |
The problem is #11961 In my company all laptops has a specific and different admin user account, so opening a Powershell and running the scripts as admin does not detect the WSL distributions because they're installed in the normal account. |
@borjamunozf thanks for following up. is there a way to install and reproduce the problem on the admin account? |
I'm modifying the script to adapt to our environment. Hopefully I'll be
able to run the script with some changes and upload the logs on Monday!
El sáb, 21 sept 2024 a las 2:20, Cătălin Emil Fetoiu (<
***@***.***>) escribió:
… @borjamunozf <https://github.com/borjamunozf> thanks for following up. is
there a way to install and reproduce the problem on the admin account?
—
Reply to this email directly, view it on GitHub
<#11966 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AGFV5D5TGQYLDYEKLBAGNCDZXS3VRAVCNFSM6AAAAABNINS4LOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRUG43TMMZVHA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Ok, this is the logs we have been able to collect in one laptop. It has been quite tricky to make it work with our company environment and account policy :/ probably some data has been not possible to gather.
Started application to collect data with the tcpdump, extremely poor performance (not even ~1Hz this time...) WslNetworkingLogs-2024-09-24_13-58-42.zip We'll try to get the same logs but in Windows 10 with 2.2.4 WSL and 12th Gen Intel(R) Core(TM) i9-12950HX EDIT: It seems that something it's missing... Will update the logs again as soon as I fix this. |
No logs.etl found in the archive. Make sure that you ran Diagnostic information
|
The log size is way higher than 25Mb, 200Mb. How could we forward it to you? |
@borjamunozf , if possible, can you please add the logs.etl file (and the rest of the files in the WslNetworkingLogs zip) in a one drive or google drive link and share it with us? Thanks |
Here is it, @CatalinFetoiu let me know if you have any issue with the access. |
Any news regarding this? Anything we could do to help? Any ideas? It's really critical for a lot of devs to able to locate and fix this problem. My best guess is that the Intel12/13th in Windows 11 with WSL is the root cause, but what do to is other story. |
Update with more tests. It's clear that for some reason the CPU processors are not being used? Test with disabled core isolation - memory integrity.
This is the actual view, 11% processor usage with the tool runining More differences regarding UDP traffic generated in Windows 10 (OK) vs Windows 11 (disastreous)
EDITED:
Any more ideas, anything that we can try? |
More tests:
sysctl -w net.core.rmem_max=4194304
sysctl net.ipv4.ipfrag_time=3
sysctl net.ipv4.ipfrag_high_thresh=134217728 Testing benchmark UDP between Windows 11 to WSL2 interface with iperf
WSL2 side iperf3 -s Windows side:
|
MAJOR UPDATE: CC @OneBlue @CatalinFetoiu (sorry for the spam, you'll have much more work than check this thread...)
I'm keen to consider that the HyperV is the responsible for messing this up somehow. Perhaps multicast traffic being dropped or not reaching at all. One more note:
We'll continue doing the tests with Ubuntu - WSL2 and try to stretch the scope of this issue and what's going on.... |
Finally, it's working fine in WSL2! Workaround:
Hypothesis:
We'll continue investigation, but it seems clearly a networking problem between multicast WSL2-Windows and not a Intel architecture one. |
wsl --install |
The official website thats for mirrored mode + WSL you need 22H2 or above? https://learn.microsoft.com/en-us/windows/wsl/networking#mirrored-mode-networking |
because WSL2(NAT)'s MTU=1420 and Windows host's MTU=1500 |
Windows Version
10.0.22631.4037
WSL Version
2.2.24
Are you using WSL 1 or WSL 2?
Kernel Version
5.15.146
Distro Version
Ubuntu 22.04
Other Software
WSL version: 2.2.4.0
Kernel version: 5.15.153.1-2
WSLg version: 1.0.61
MSRDC version: 1.2.5326
Direct3D version: 1.611.1-81528511
DXCore version: 10.0.26091.1-240325-1447.ge-release
Windows version: 10.0.22631.4037
Repro Steps
Expected Behavior
Packets are not lost in WSL & performance are the expected (~16Hz)
Actual Behavior
Three developers in my company has encountered strange performance issues in an application. This does not ocurred before without WSL!
The scenario is following:
From Windows side all looks good, the topic is published every ~6ms like a clock.
But from WSL a lot of packages are missing. It's only receiving like 1 update per second on average.
I have established the /proc/sys/net/core/rmem_max" to higher value = 2203936 and added this to the kernel:
CONFIG_IP_MULTICAST=y
It seems that this has slighly improved performance. However It starts really nice and afterwards it just get bad again.
Diagnostic Logs
No response
The text was updated successfully, but these errors were encountered: