where's socketTextStream in pyflink

Question

I want to translate the following code into pyflink and run it in pyflink-shell.sh afterwards.

public class MapDemo {
    private static int index = 1;
    public static void main(String[] args) throws Exception {
        //1.获取执行环境配置信息
        StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
        //2.定义加载或创建数据源（source）,监听9000端口的socket消息
        DataStream<String> textStream = env.socketTextStream("localhost", 9000, "\n");
        //3.map操作。
        DataStream<String> result = textStream.map(s -> (index++) + ".您输入的是：" + s);
        //4.打印输出sink
        result.print();
        //5.开始执行
        env.execute();
    }

But I can not found socketTextStreamin b_env,bt_env,s_env,st_env

so where's the socketTextStream in pyflink api?

David Anderson · Accepted Answer · 2020-12-23T11:03:35.387

2

As of Flink 1.12, out-of-the-box PyFlink appears to only support these connectors:

FlinkKafkaConsumer
FlinkKafkaProducer
JdbcSink
StreamingFileSink

See https://github.com/apache/flink/blob/master/flink-python/pyflink/datastream/connectors.py.

Because socketTextStream cannot support exactly-once semantics, its use is generally discouraged, and it wasn't included in PyFlink.

edited Dec 23 '20 at 11:03

answered Jun 12 '20 at 15:04

David Anderson

39,434
4
33
60

Is this still the case? I'm seeing a Python DataStream API. – MjBVala Dec 23 '20 at 00:03
That's true, and I've updated my answer. But I believe `socketTextStream` is still not available. – David Anderson Dec 23 '20 at 11:04
Yeah I looked into the mailing list threads and the socket stream isn't being implemented (at least for now) for the reasons you mentioned. – MjBVala Dec 24 '20 at 06:36

score 0 · Answer 2 · answered Jun 12 '21 at 16:21

Yes, you can use socketTextStream in pyflink, though it has not been officially supported yet. Example:

from pyflink.datastream import DataStream, StreamExecutionEnvironment

if __name__ == '__main__':
    s_env = StreamExecutionEnvironment.get_execution_environment()
    socket_stream = DataStream(s_env._j_stream_execution_environment.socketTextStream('localhost', 9999))
    socket_stream.print()
    s_env.execute('socket_stream')

where's socketTextStream in pyflink

2 Answers2