Questions tagged [sink]

Command in the programming language R. Sends R Output to a connection.

Command in the R programming language. Sends R Output to a connection.

Related tags:

187 questions
1
vote
0 answers

Not all log entries are written when using serilog and Winforms app

I´ve searched Google & Co quite a while without any result, so sorry if my question has been answered somewhere else... I´ve been using Serilog within Blazor server apps with no problems and decided to use Serilog for my Winforms apps as…
AnjinSan
  • 11
  • 2
1
vote
1 answer

Apache Pulsar JDBC sink: differentiation between insert/update/delete

I'm currently examining Pulsar JDBC sinks, as we plan to use a PostgresSQL sink soon. Now, it's mentioned that JDBC sinks support insert/update/delete ops, but I wasn't able to find any documentation on HOW the sink connector actually decides on…
Toni Kanoni
  • 2,265
  • 4
  • 23
  • 29
1
vote
1 answer

S3 Sink Connector not creating key or header files within bucket

I'm using the latest version of the S3 Sink Connector (v10.0.5) and enabled both the kafka.keys and kafka.headers but only value files are being created. Here's a copy of our…
Nic71
  • 21
  • 5
1
vote
0 answers

Copy R output into a word document

Is there a proper way/a command to copy the output of R and paste it in a Word document, without loosing the formatting? I already tried to put the next command at the beginning of my syntax: sink("./output.txt", append = T) #write output to file…
1
vote
2 answers

Flink same source different sinks

Using flink I want to use a single source and after processing through different process functions want to dump into different sinks. What should be used for this parallel computation and different sinks.
Ben 10
  • 11
  • 1
1
vote
2 answers

Is there a way to save RStudio console warnings and messages? Sink() doesn't work

I ran a function which produced the following messages: [Output truncated]No imagary was found at location 13.51418,100.525398094512No imagary was found at location 13.5142126237624,100.519283133217No imagary was found at location…
1
vote
0 answers

Send sink() output to multiple files - R

Is it possible to send sink() output to multiple files? I would like it to do the following: sink("log1.txt", append=T) sink("log2.txt") print("output text") and have the "output text" appear in both files. Currently, it only appears to write to…
Laurence_jj
  • 646
  • 1
  • 10
  • 23
1
vote
1 answer

Kafka Connect S3 Sink Flush data - Strange lag

I've a TABLE created from KSQL query and inut Stream that is backed by a Kafka Topic. This topic is sink to s3 using Kafka Connect. In the topic, I have around 1k msgs/sec. The topic has 6 partitions and 3 replicas. I have a strange output ratio.…
1
vote
2 answers

How to use Cassandra sink with TestContainers in Flink

Im trying to test Cassandra Sink with use of TestContainers in a simple Flink pipeline which use DataStreamTestBase for tests: public class CassandraPojoSinkExampleTest extends DataStreamTestBase { @Rule public CassandraContainer cassandra…
Baal
  • 77
  • 8
1
vote
1 answer

Use sink() in combination with rmarkdown::render() within loop to detect errors for scheduled .Rmd reports

Background: I am creating a script that logs the console output of a markdown file. It is needed in order to track errors within scheduled reports that run frequently. In the end - in case there is an error appearing while rendering - the log.txt…
Arut
  • 39
  • 5
1
vote
2 answers

R: Redirecting to both stdout and a file on the fly

Is there a way to redirect the R - output into a file and print it to stdout at the same time, on the fly? I want to monitor the progress and document it in a file. sink() can't do both, it seems. Found the function tee on Unix (I use Mac and Linux)…
4554888
  • 87
  • 1
  • 11
1
vote
1 answer

Spark Structured Streaming redis sink perform not desirable

I've used spark structured streaming conume kafka messages and save data to redis. By extending the ForeachWriter[org.apache.spark.sql.Row], I used a redis sink to save data. The code runs well but just a little more than 100 datas be saved to redis…
lf.D
  • 25
  • 7
1
vote
1 answer

Sink console output to .txt file from a function

I need to populate a .txt file while running a code with nested functions. I use sink() for this purpose. The output consists of a) text messages, b) dataframe rows. I fail to print dataframes from inside the nested…
1
vote
0 answers

Writing to a nested JSON array in Azure data factory

I am trying to convert data from a CSV file to JSON with nested array. I want the following source data JobId JobDate Skill SkillCluster 1 20122019 100 SkillTest1 1 20122019 200 SkillTest2 1 20122019 300 …
1
vote
0 answers

Sink to SQL Server table using azure data factory pipeline using stored procedure not working

I need to copy blob storage csv file data to sql server table. But I also required some additional column in destination while using copy activity in azure data factory pipeline. I refer this link…