Apache NiFi as an Orchestration Engine

Apache NiFi as an Orchestration Engine Orchestration of services is a pivotal part of Service Oriented Architecture (SOA). Apache NiFi provides a highly configurable simple Web-based user interface to design orchestration framework that can address enterprise level data flow and orchestration needs together. While most other frameworks primarily are for service orchestration only, NiFi can …

Scala – Beyond Spark Jobs

If you’re in tune with the goings on in the realm of “Big Data,” you’ve no doubt heard of, if not worked with, a nifty distributed data processing platform by the name of Apache Spark. If you’ve tinkered around with Spark at all, you’ll have at least heard of a programming language by the name …

Cross-Platform Mobile App Development with Xamarin

Have you ever stopped to really think about that Facebook or Reddit mobile app that you’re always on? Mobile development is not the new kid on the block anymore, but until just a few years ago, cross-platform mobile development was this giant mythical beast that didn’t exist. With the market share for mobile being primarily …

Spark RDD vs Spark SQL Performance comparison using Spark Java APIs

Resilient Distributed Dataset (RDD) is the main abstraction of Spark framework while Spark SQL (a Spark module for structured data processing) provides Spark more information about the structure of both the data and the computation being performed, and therefore uses this extra information to perform extra optimizations. Up until Spark 1.6, RDDs used to perform …

5 Lessons I Learned My First 18 Months in Recruiting

One of my favorite recruiting stories starts standardly with me reaching out to a candidate and following up with an email.  The candidate responded by asking me why I was working so late and not cruising around in my convertible living the fabulous and high life that is Technology Recruiting. *note, I don’t have a …

Data Science …as a Service

The data race is in full swing. Nearly every customer I work with is attempting to collect and store as much data as possible. Twitter/Facebook feeds, web activity logs, 3rd party demographic data, GIS data, internal server logs, IoT data and more than before are being stored in ever larger data stores. This race to …

What I learned as a Consultant

Just under three years ago, I took my first consulting job. Before consulting, I worked primarily in research and development, and before that, I was in graduate school, which is a lot like research and development without the paycheck. I knew from a technical perspective I’d be ready – at that point, I’d had roughly …

Driven by Big Data: Replacing Google Search Appliance

Elastic {ON} has always been a great place to witness the sheer excitement shared by the developers and their management teams with Enterprise Search technologies.  As a leading partner and sponsor of such events, we get a first-hand look at the adaptability of this technology and how it fits well with a diverse set of …

How’s your Data Warehouse…Now?

So, how’s your Data Warehouse doing? Yes, I know Data Warehousing is so 2007, it’s all about your Data Lake now. What does that even mean? Let me ask you, did you spend any time with anyone other than IT managers and other technologists pondering the question, “Why do I need a Data Lake?” Or …

Women in Technology – Promoting a Gender Diverse Team

In light of the recent Women’s March and the impressive turnout Austin received, a debate has opened for women’s equality and their representation in the workplace. With Austin being one of the largest tech capitals of the U.S, one might wonder why women in the IT field are still harder to find than a bug …
newer posts older posts