July 2019

A Brief Intro to SQL

digitado ⋅ 31 de July de 2019

A lot of people say “S..Q..L”, by separating the letters or some pronounce it as “sequel”. It’s up to you, I like “sequel”, it just sounds cooler. SQL is a superrrrrrrrrrr important skill to learn when dealing with huge amounts of data sets. SQL, which stands for Structured Query Language, is a programming language used for retrieving data and manipulating the data models (aka in table format). To specify that, it is used to extract data from a relational […]

Ver mais

Like 0

Liked Liked

technocracy

Outliers Detection in PySpark #2 – Interquartile Range

digitado ⋅ 15 de July de 2019

In the first part, I talked about what Data Quality, Anomaly Detection and Outliers Detection are and what’s the difference between outliers detection and novelty detection. In this part, I will talk about a very known and easy method to detect outliers called Interquartile Range. Introduction The Interquartile Range method, also known as IQR, was developed by John Widler Turky, an American mathematician best known for development of the FFT algorithm and box plot.

Ver mais

Like 0

Liked Liked