How to increase message size in grpc using python

Question

I am using grpc for message passing and am testing a simple server and client. When my message size goes over the limit, I get this error.

grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with 
(StatusCode.INVALID_ARGUMENT,
 Received message larger than max (7309898 vs. 4194304))>

How do I increase the message size on the server and client side?

score 38 · Accepted Answer · edited Nov 13 '19 at 14:04

38

Changing the message_length for both send and receive will do the trick.

channel = grpc.insecure_channel(
    'localhost:50051',
    options=[
        ('grpc.max_send_message_length', MAX_MESSAGE_LENGTH),
        ('grpc.max_receive_message_length', MAX_MESSAGE_LENGTH),
    ],
)

edited Nov 13 '19 at 14:04

jso

484
5
13

answered Mar 07 '17 at 18:19

Dumbo

1,068
2
12
21

1

@duck maybe you only change the server or client? try change from both sides – ospider Sep 26 '18 at 02:00
is `MAX_MESSAGE_LENGTH` a python or grpc default value or customer defined value? – Lei Yang May 11 '22 at 06:44

score 16 · Answer 2 · answered Nov 25 '20 at 17:02

I had this problem, I solved it by setting the 'grpc.max_send_message_length' and 'grpc.max_receive_message_length' on both the client and the server:

In client (Credit to @Dumbo for this code snippet):

channel = grpc.insecure_channel(
    'localhost:50051',
    options=[
        ('grpc.max_send_message_length', MAX_MESSAGE_LENGTH),
        ('grpc.max_receive_message_length', MAX_MESSAGE_LENGTH),
    ],
)

In server:

server = grpc.server(futures.ThreadPoolExecutor(max_workers=10), options = [
        ('grpc.max_send_message_length', MAX_MESSAGE_LENGTH),
        ('grpc.max_receive_message_length', MAX_MESSAGE_LENGTH)
    ])

score 2 · Answer 3 · answered Feb 11 '22 at 10:07

Adding to the existing answers, you can find a list of all key-value pair options in the github repo - see below

From the grpc-Glossary

channel_arguments A list of key-value pairs to configure the underlying gRPC Core channel or server object. Channel arguments are meant for advanced usages and contain experimental API (some may not labeled as experimental). Full list of available channel arguments and documentation can be found under the “grpc_arg_keys” section of “grpc_types.h” header file (https://github.com/grpc/grpc/blob/v1.43.x/include/grpc/impl/codegen/grpc_types.h). For example, if you want to disable TCP port reuse, you may construct channel arguments like: options = (('grpc.so_reuseport', 0),).

score -6 · Answer 4 · answered Mar 06 '17 at 16:09

-6

You should not increase the message size.
It comes with a performance penalty.
In real situations one implements paging to split too large messages.

answered Mar 06 '17 at 16:09

weismat

7,195
3
43
58

1

maybe, but I still want to see if it is possible and what the performance penalty will be . – Dumbo Mar 07 '17 at 18:18
3

There is no golden setting that fits all environments – ospider Sep 26 '18 at 01:41

How to increase message size in grpc using python

4 Answers4

Linked