Decision Tree in Apache Spark

Knoldus

What is Decision Tree?

A decision tree is a powerful method for classification and prediction and for facilitating decision making in sequential decision problems. A Decision tree is made up of two components:-
  • A Decision
  • Outcome

and, A Decision tree includes three type of Nodes:-

  • Root node: The top node of the tree comprising all the data.
  • Splitting node: A node that assigns data to a subgroup.
  • Terminal node: Final decision (outcome).

To reach to an outcome or to get the result, the process starts with the root node, based on decision made on root node the next node i.e. splitter node is selected and based on decision made on split node another child split node is selected and this process goes on we reach to the terminal node and value of terminal node is our outcome.

Decision Tree in Apache Spark

It might sound strange or…

View original post 636 more words

Advertisements

Learning the maths for Feed Forward Network

Knoldus

In my last blog we were discussing about the biological motivation on the artificial neural network. This time we will discuss more about the artificial neural network in practice. In ANN we have different layers of networks to solve a problem. For which problem, how many layers required to solve it, is a different topic and will be writing a blog on that soon, however we can still proceed to implementing the network and making it learn to solve the problem. No doubt as programmer we understand code better and pick anything up pretty quickly. ANN also could be learn directly by going through the code, however so far what I feel is that knowing the maths behind the ANN algorithm helps more in understanding the process. So before going to the code I would be discussing about the maths behind it. The below image and all its description are…

View original post 556 more words

Forget It! Going Digital & You haven’t heard Reactive?

Knoldus

Today, you talk to any CIO, attend any CDO conference and it would have a track about going Digital. Digital transformation is a sought out area to invest … err … throw money. Without knowing how digital is going to help you and what is the technology stack that can allow you to go truly digital, I do not recommend any CIO/CDO to get into the ring.

The 3 main objectives that any digital strategy should be focused on would be

  • Customer Experience (CX)
  • Operation Process
  • Business Model

As Forrester suggests, you should not develop a digital strategy but you should rather Digitize your business strategy. You are the domain expert, you know your business best, you know who your competition is and again, you know how your customers like it. So, rather than trying to create a Digital Strategy and bolt on your business, you would rather try…

View original post 578 more words

Akka Split Brain Resolver – Problem and its Solution

Knoldus

AKKA Split Brain Resolver

When operating an Akka cluster the developer will surely comes around network partitions (Split Brain scenarios) and machine crashes. There are multiple strategies present by lightbend to handle such erratic behavior and, after a deeper explanation of the problem we are facing, I will try to present them along with their pros and cons using the Split Brain Resolver in Akka, which is a part of the Reactive Platform.

The Problem Statement

The basic is as follows – a node cannot differentiate between complete crashes and temporary network failures that could get resolved.

– In our current scenarios the network tracks the state and health of the nodes it contains using a “heartbeat”. This is a mechanism where each node sends a simple message in a given interval (for example with a time delta) to every other node that basically says “I’m OK”. The system makes…

View original post 1,450 more words

When I took Angular 2 to build my Application

Knoldus

As most of us knows that AngularJS is a very powerful framework. It is the third most starred repository on GitHub.

When I took Angular 2 to build my application, I still had my doubts to go with Angular 2 or some other framework.
But after some research, I made up my mind and decided to work on Angular 2.

Here are some reasons / advantages that I liked

It gives the ability to make Single Page Application in a perfect and viable way.

1. TypeScript : Unlike javascript, typescript is type safe, that means, it can generate errors at compile time only.

TypeScript is an extension of ECMAScript, in fact:
TypeScript = ES6 + Types + Annotations

Type script is purely Object oriented tries to extend object oriented javascript. It is quite common to  work with classes and modules in JavaScript, but it requires some amount of boilerplate code…

View original post 455 more words

Knoldus Partners with Confluent to Power Real Time Streams

Knoldus

Knoldus is pleased to announce a Consulting and System Integrator partnership with Confluent, the company founded by the creators of Apache KafkaTM

Confluent, creators of the first streaming platform based on Apache KafkaTM, provides the most complete platform to build enterprise-scale streaming pipelines using Apache Kafka and simplify the development of stream processing applications. Via rapid adoption in the Fortune 500, Apache Kafka is quickly emerging as the leading streaming platform for real-time applications. Data-centric businesses can scale their production environments with confidence in its reliability, efficiency and scalability for hundreds of use cases, thousands of applications and trillions of messages.

Leveraging the power of Apache Kafka and Confluent Platform, Knoldus has already deployed several fast data solutions into production. One of the very first deployments of Knoldus on Kafka was in early 2012 for real time sentiment analysis platform which is being used by Coke, Target, P&G…

View original post 432 more words

Javascript Style Checker

Knoldus

Despite many years of experience, people still type variable names incorrectly, make syntax errors and forget to handle errors properly and forget about the best practices in hurry. But its important to write the quality code. A good linting tool, or a linter, will help to check the code errors and the standard style before someone waste their time—or worse, client’s time.

First of all, I will be describing some standard javascript rules and then the lint tools available to check for javascript standard and how the tools can be integrated with IntelliJ IDEA.

Some Standard JavaScript rules.

  • Use 2 spaces for indentation

  • Use single quotes for strings except to avoid escaping.

  • No unused variables

  • Add a space after keywords.

  • Add a space before a function declaration’s parentheses.

  • Always use=== instead of ==.

  • Infix operators must be spaced

  • Commas should have a space after them

  • Always handle the err…

View original post 612 more words