Skip to content

Fifo test with data transfer between multiple GPUs #596

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
seagater wants to merge 31 commits into
base: main
Choose a base branch
from
+518 −14
Open

Fifo test with data transfer between multiple GPUs #596

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
af1427b
WIP
seagater Jul 17, 2025
c4d1c14
Add context to store communicator and connections; Update fifo_test_m…
seagater Jul 18, 2025
d05153f
Update
seagater Jul 18, 2025
21a1595
Fix hang issue in the consumeTriggers
seagater Jul 21, 2025
cb67275
Use multiple threads in each thread block for kernel launch
seagater Jul 21, 2025
1db0c60
Add portHandle.signal and wait for threadId=0 in all thread blocks
seagater Jul 22, 2025
1eadcc9
Remove unused apis
seagater Jul 22, 2025
6a25db1
Clean print commands
seagater Jul 22, 2025
d8f8a0b
Fix clang-format error
seagater Jul 22, 2025
c3a0ec3
Clean unused variables
seagater Jul 23, 2025
a0d73ec
Relocate connection creation outside of the runMultipleTests function…
seagater Jul 23, 2025
3c15ded
Fix clang-format issue
seagater Jul 23, 2025
5eee1ff
Add data transfer between two GPUs
seagater Jul 23, 2025
c523a32
Update
seagater Jul 23, 2025
935f1d4
Use only global thread 0 for signal and wait
seagater Jul 28, 2025
d8832bc
Fix data validation issue
seagater Jul 31, 2025
706cb39
Merge branch 'main' into qinghuazhou/fifo-test-multi-gpu-write-data
seagater Jul 31, 2025
1602b35
Add bidirectional data transfer between two GPUs
seagater Aug 1, 2025
8c119d1
Merge branch 'main' into qinghuazhou/fifo-test-multi-gpu-write-data
seagater Aug 4, 2025
2df8ae8
New file for fifo_test_multi_gpu_data_transfer
seagater Aug 4, 2025
b1a447a
Remove unused functions
seagater Aug 4, 2025
c422fa6
Remove unused device handle and hostFifo
seagater Aug 4, 2025
e85c826
Update test name
seagater Aug 4, 2025
c10cc58
Support both legacy new interface for runMultipleTests
seagater Aug 4, 2025
eaff65a
Support both legacy and new interface for runMultipleTests
seagater Aug 4, 2025
5c2d5c2
Merge branch 'qinghuazhou/fifo-test-multi-gpu-write-data' of https://…
seagater Aug 4, 2025
539c7ef
Merge branch 'main' into qinghuazhou/fifo-test-multi-gpu-write-data
seagater Aug 4, 2025
1f6936d
Add CI test for fifo_test_multi_gpu_data_transfer
seagater Aug 4, 2025
a0b6c75
Merge branch 'main' into qinghuazhou/fifo-test-multi-gpu-write-data
seagater Aug 4, 2025
a40b1ff
Clean print messages
seagater Aug 5, 2025
c4fdc3f
Update CI test and calculation for total elements.
seagater Aug 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .azure-pipelines/templates/integration-test.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,9 @@ steps:
export PATH=/usr/local/mpi/bin:\$PATH; \
export LD_LIBRARY_PATH=/root/mscclpp/build:\$LD_LIBRARY_PATH; \
cd /root/mscclpp; \
./build/test/perf/fifo_test"'
./build/test/perf/fifo_test; \
echo \"mpirun --allow-run-as-root -np 2 ./build/test/perf/fifo_test_multi_gpu_data_transfer\"; \
mpirun --allow-run-as-root -np 2 ./build/test/perf/fifo_test_multi_gpu_data_transfer"'
kill $CHILD_PID
workingDirectory: '$(System.DefaultWorkingDirectory)'

Expand Down
1 change: 1 addition & 0 deletions test/perf/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,3 +40,4 @@ endfunction()

# Add FIFO test
add_perf_test_executable(fifo_test "framework.cc;fifo_test.cu")
add_perf_test_executable(fifo_test_multi_gpu_data_transfer "framework.cc;fifo_test_multi_gpu_data_transfer.cu")
Loading
Loading