snowflake pipe status numOutstandingMessagesOnChannel

Question

I have a pipe that seems to be set up fine, but it just isn't working.

I ran

select system$pipe_status('"MY_DB"."MY_SCHEMA".MY_PIPE_NAME');

i'm getting back a growing number of numOutstandingMessagesOnChannel

Can someone please explain what that means?

Is that rows that will be processed? Do I expect this number to go down? Is there a number where it's too high?

Is there something / some way to track why/when it goes up?

The documentation says merely,

numOutstandingMessagesOnChannel
Number of messages in the queue that have been queued but not received yet.

Hey! Have you resolved this issue? I'm having the same problem. — bellotto, May 04 '23 at 13:37
Hey @bellotto Are you facing issues on snowpipe and observing a growing number for parameter numOutstandingMessagesOnChannel? — Tushar Kathpal, Jun 18 '23 at 12:06

score 0 · Answer 1 · edited Nov 16 '22 at 00:39

numOutstandingMessagesOnChannel => Number of messages in the external cloud provider queue that have been queued but not received by Snowflake yet. ( this is not real-time, it's an approximate value)

The numOutstandingMessagesOnChannel should fluctuate if continuously ingesting at a very high rate and Snowflake is not able to process, throttling would occur.

Best to open a case with Snowflake Support, and we can look into the pipe status in more detail for you.

snowflake pipe status numOutstandingMessagesOnChannel

1 Answers1