Data Import

Now we have our fake log generator built, we hope to be able to import these log lines into our analyzer. There are several ways to do this:

• File Input
• Socket Input
• Kafka Input

We can first write logs into files, then let the monitor itself access the files. Or we can use TCP protocol to send generated logs into our monitor (Spark Streaming Application). At last, to better support multiple log sources, we can add Kafka to our platform.