Keyboard Shortcuts
Likes
- Wallaroo
- Messages
Search
|
Re: Need your review and guide : DDoS Detection using Wallaroo
Sean T. Allen
You are definitely missing some things that the directions instruct you to install. Id suggest either starting over with a new image and make sure everything in the directions works without error. The other option is to use the Vagrantfile that we provide and for which, there are instructions to use. Those instructions are in my first email. On Sun, Jul 22, 2018, 19:50 farzana zakaria <farzanazakaria96@...> wrote:
|
|
Re: Need your review and guide : DDoS Detection using Wallaroo
Hi, I'm using this direction??on virtualbox and vmware workstation? I think I having trouble with pony compiler . It is necessary to install ponyc and pony-stable. I don know whether I install the library in wrong directory or what . I just follow the instruction given.? When I run make command in machida , its gonna be a few error On Mon, Jul 23, 2018 at 6:40 AM, Sean T. Allen <sean@...> wrote:
|
|
Re: Need your review and guide : DDoS Detection using Wallaroo
Sean T. Allen
Hi Farzana, Sorry to hear you are having trouble, What directions did you use to setup your virtual box Wallaroo environment? Did you use these directions? If not, what directions did you use? -Sean- On Sun, Jul 22, 2018 at 2:02 PM farzana zakaria <farzanazakaria96@...> wrote:
|
|
Need your review and guide : DDoS Detection using Wallaroo
Hi. I have a problem in setup the wallaroo environment for ubuntu trusty. I am trying to run the ddos detection using wallaroo but it fails . I got some error when enter the make command in machida directory. For ubuntu in virtual box , some error like /bin/sh : stable not found? make***? ?(like that) and for ubuntu in vmware I got error like? cat VERSION .. No LLVM installation found. Stop Could you help me solve this problem. TQ |
|
Re: How to read and write MQTT msgs from a Wallaroo python app?
Sean T. Allen
Hi Martin, Thanks for your questions. Didn't feel like a long message at all. We have a project that we call "Bring Your Own Integrations" that is currently underway. A preview version should be released in two to three weeks. Bring Your Own Integrations, or BYOI as we call it, will allow Wallaroo users like you to write source and sinks in Python (or any other language). The results of BYOI are definitely what you are looking for. Currently, you would need to use the TCP support to write bridge applications that understand how to read and write MQTT and then send/receive from Wallaroo over TCP. You can see examples of this (not MQTT) in our streaming Twitter application example where there is a Python "client" that reads from the Twitter API and writes to Wallaroo over TCP. The twitter example code is here: The specific "client" that I'm referencing is here: When BYOI is released, there will be full documentation on how to use. We'd love to work with you on getting MQTT working and help you evaluate Wallaroo. We'd be happy to do a call or more private emails to discuss your use-case and help you make it a success. When the preview release of BYOI is released, we'll be announcing it here on the mailing list as well as elsewhere. -Sean- |
|
How to read and write MQTT msgs from a Wallaroo python app?
Hi all, We are currently trying to evaluate Wallaroo to see if it is suitable for our streaming framework. We want to write a python streaming Wallaroo app that needs to read messages from MQTT topics, do some processing and write out to other MQTT topics. However it is not very clear what is the best/easiest way to do that. It seems Wallaroo is using a slightly more involved way of streaming input and output than other frameworks like Flink, Spark, Storm where you have standard interfaces for sources and sinks which can be implemented to read and write from any systems using high level clients for those particular systems/protocols. With Wallaroo the process seems a lot more low level. From what we understand we need to write a python decoder and encoder for lets say raw MQTT msg bytes for example. But we would still need to write another piece of code/program that uses an MQTT client (in some language ... python or pony?) to subscribe to topics and send them on the TCP port where the app source is listening. Is that correct? Is there a python interface for that? Or does that need to be a Pony component? What is the lifecycle of that component? Could not find a tutorial in the docs that shows how to add a support for a new protocol start to finish, is there something like that? Sorry for the long message, thanks! M |
|
New Blost Post: Stream processing, trending hashtags, and Wallaroo
Sean T. Allen
Good morning! Wallaroo Labs blog post time. This week, I wrote about a common pattern in real-time data processing. How you can get the "top k" for a live data set and do it in a parallel scalable fashion. Hope you enjoy! |
|
New Blog Post: Exploring The GitHub Archive
In an attempt to make diving into Wallaroo a little easier I decided to go write my own application. Here is the project and blog post that came from that. I explore the GitHub Archive event stream using Python, Kafka, and Docker. Give it a shot if you've been wondering how you might use Wallaroo with containers or want to see how Kafka support works in practice. |
|
Error with docker pull for Metrics UI in 0.4.2
Hi all,
We realized that there's a `filesystem layer verification failed for digest sha256:` error when attempting to pull the Metrics UI for users installing Wallaroo from Source. We are working on fixing this and will update you all when it is corrected! Thanks for your patience, Jonathan |
|
New Blog Post: Wallaroo: We¡¯ve heard your feedback, here¡¯s what¡¯s coming
Sean T. Allen
Long delay on posting this as I forgot to do it last week. I thought I had hit send, but apparently never did. Anyway, I wrote a blog post about what is coming in Wallaroo over the next few months. We've got some cool stuff coming, check it out! |
|
New Blog Post: Adventures with cgo: Part 1- The Pointering
Sean T. Allen
Hi y'all, We've learned a lot about working with Go from another language. Today, I published part 1 of a 4 part series about what we've learned. Today's post covers issues you will run into if you call Go code from another language and want to hold on to pointers to Go objects. It's good stuff. Hope you enjoy. => -Sean- |
|
Re: New blog post: Some Common Mitigation Techniques for Overload in Queueing Networks
Scott Fritchie
Howdy, everyone.? Part two of the small blog series on back-pressure mitigation is now available.? Titled "How the end-to-end back-pressure mechanism inside Wallaroo works", it is now online at: Thanks for reading! -Scott |