Skip to content

Conversation

@sunlei1024
Copy link
Collaborator

Motivation

This pull request introduces tensor transmission support between the work and engine modules.
A zero-copy mechanism is implemented to eliminate unnecessary memory copying during data exchange, significantly improving transmission efficiency and reducing memory overhead.


Modifications

  • Added support for transmitting tensor data between work and engine.
  • Implemented zero-copy in the ZMQ-based communication layer to avoid redundant data copying.
  • Optimized serialization/deserialization logic for high-performance data transfer.
  • Ensured backward compatibility with the existing communication protocol and interfaces.

Accuracy Tests

This change only affects the communication layer and does not modify model computation logic.
Data consistency has been verified across multiple tensor types and shapes (bitwise equality confirmed).


Checklist

  • Added appropriate PR tags ([Feature][Engine]).
  • Code formatted and passed pre-commit checks.
  • Verified zero-copy path correctness with tensors of different shapes and data types.
  • No accuracy regression observed.
  • Unit tests for tensor transmission to be added (pending review).

@paddle-bot
Copy link

paddle-bot bot commented Nov 5, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Nov 5, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 3098aee into PaddlePaddle:develop Nov 11, 2025
19 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants