Image Compression In Python: Huffman Encoding
Huffman Coding This blog will be completed with much more exercises on dataqoil.com.
Posts by Category
- Computer Vision 29
- Programming 26
- Project 21
- Image Processing 15
- Data Analysis 12
- Python 11
- Machine Learning 10
- Artificial Intelligence 9
- Data Science 7
- Stock Market Analysis 6
- Game Development 5
- apache airflow 5
- data engineering 5
- data pipelining 5
- Projects 4
- MySQL 3
- Technical Analysis 3
- EDA 3
- Web App 3
- Games 2
- Streamlit 2
- Statistics 2
- Timeseries Analysis 2
- Stock 2
- urllib3 2
- CNN 2
- blog 1
- Unity3D 1
- Software 1
- github-pages 1
- Agriculture 1
- adventofcode 1
- challenges 1
- Pandas 1
- data visualization 1
- Julia 1
- Clustering 1
- mysql 1
- 1
- 1
- ARIMA 1
- Probability 1
- Alpaca API 1
- Concurrent Programming 1
- Asyncio 1
- Pyscript 1
- Javascript 1
- Triggers 1
- Tweets 1
- Data Visualization 1
- Apache Superset 1
- SMTPlib 1
- Polygon 1
- streamlit 1
- apache2 1
- BeautifulSoup 1
- weather-bot 1
- fractal 1
- mathematics 1
- OpenCV 1
- datetime 1
- multi-threading 1
- Backtesting 1
- DateTime 1
- Text Processing 1
- programming 1
- remote jobs 1
- cryptography 1
- Challenge 1
Computer Vision
Gesture Based Calculator
Gesture Based Calculator Hello and welcome everyone to our last project on the #7DaysOfComputerVisionProjects series where we did some cool computer vision p...
Game: Kill a Fly
Kill The Fly Hello surfer, if you were following our series #7DaysOfComputerVisionProjects then this is the 6th project and this is going to be different and...
Gesture Based Visually Writing System
Gesture Based Writing Method Introduction Hello surfer, welcome to this blog where I will be writing a Python code to write something in canvas by moving fin...
Auto Trex: Playing Chrome Trex Game with Image Processing
Playing Trex Game With Image Processing Hello everyone, in the last part, we used gestures to perform jump and duck but in this part, we will not use gesture...
Playing Chrome Trex Game with Gestures
Play Trex Game on Chrome By Gesture Using OpenCV and Mediapipe Hello there surfer! Since few days, I am thinking about some cool projects that can be done w...
Air Mouse: Controlling Mouse With Gestures in Air
Air Mouse: Doing Mouse Operations Using Finger Gestures Hey surfer, in this blog, I am going to write about how can we do basic mouse operations like move po...
Realtime Background Changing in Python
Real Time Background Changing With OpenCV and Python This blog is the part of the series #7DaysOfComputerVisionProjects. Links to the blogs and videos of eac...
Image Compression In Python: Run Length Encoding
Run Length Encoding is one of the image compression algorithms that is lossless. So let’s get started. (Teaser Image taken from here.) If you are intere...
Getting Started With OpenCV in C/C++ in Windows
How to configure OpenCV for C/C++ in Windows? Installing OpenCV is very hard task because of various things like build error and Compiler Error. So in this t...
Messing Up With Convolutional Neural Nets: Autoencoder for Grayscale to RGB Image
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff. Image colorization has recently been popular with the...
Corn Leaf Infection Detection: Data Preprocessing and Custom Datagenerator
Introduction Here on this blog, I will be giving a gentle introduction about how to do Region Based Detection project on python from scratch. The scratch mea...
Deploying Face Mask Classifier on Heroku: Deploy on Heroku
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Deploying Face Mask Classifier on Heroku: Train Classifier
This is a part 1 of a blogging series. Part 1: Deploying Face Mask Classifier on Heroku: Building a Classifier Part 2: Deploying Face Mask Classifier on...
OCR For Devanagari Handwritten Character: Web APP
This is a part 3 of a blogging series. Part 1: OCR for DHC: Building a Classifier Part 2: OCR for DHC: Segmentation, Localization and First Version Pa...
OCR For Devanagari Handwritten Character: Segmentation, Localization using NumPy
A localization, segmentation and the first version of OCR using NumPy.
OCR For Devanagari Handwritten Character: Building a Classifier
A Devanagari Handwritten Characters Classifier using CNN on Keras.
Contour Based Game: Break The Bricks
Contents
Drawing Simple Geometrical Shapes on Python Using NumPy and Visualize It
Contents Drawing Simple Geometrical Shapes on Python from scratch, have you tried it?
Gesture Based Visually Writing System Using OpenCV and Python
This is the first part of Gesture Based Visually Writing System. Gesture Based Visually Writing System Using OpenCV and Python Gesture Based Visually Wr...
Image Processing Class from Scratch on Python
Contents 1.1 What am I using? 1.2 What this blog includes? 2 Steps Initializing a ImageProcessing class Adding a read method Add...
Building OCR For Devanagari Handwritten Character
Using Keras, OpenCv, Numpy build a simple OCR. Contents Inspiration Devanagari is popular across India and Nepal. It is also a National font of ...
Crowd Counting Made Easy
Contents Experience Of Being Udacity Scholar: As a scholar of Udacity’s Secure and Private AI Challenge course by Facebook, I have not only learned abo...
Programming
Getting Started With OpenCV in C/C++ in Windows
How to configure OpenCV for C/C++ in Windows? Installing OpenCV is very hard task because of various things like build error and Compiler Error. So in this t...
Messing Up With Convolutional Neural Nets: Autoencoder for Grayscale to RGB Image
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff. Image colorization has recently been popular with the...
Building Machine Learning Apps Faster With dstack.ai
Building Machine Learning Apps Faster With dstack.ai Happy New Year everyone!
Building Data Apps Faster With dstack.ai
Getting Started With dstack.ai This blog contains a minimal example of making data apps using dstack.
NEPSE Data Visualizing and Deploy it on Heroku
Introduction I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Corn Leaf Infection Detection: Data Preprocessing and Custom Datagenerator
Introduction Here on this blog, I will be giving a gentle introduction about how to do Region Based Detection project on python from scratch. The scratch mea...
Deploying Face Mask Classifier on Heroku: Deploy on Heroku
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Deploying Face Mask Classifier on Heroku: Train Classifier
This is a part 1 of a blogging series. Part 1: Deploying Face Mask Classifier on Heroku: Building a Classifier Part 2: Deploying Face Mask Classifier on...
OCR For Devanagari Handwritten Character: Web APP
This is a part 3 of a blogging series. Part 1: OCR for DHC: Building a Classifier Part 2: OCR for DHC: Segmentation, Localization and First Version Pa...
OCR For Devanagari Handwritten Character: Segmentation, Localization using NumPy
A localization, segmentation and the first version of OCR using NumPy.
OCR For Devanagari Handwritten Character: Building a Classifier
A Devanagari Handwritten Characters Classifier using CNN on Keras.
Drawing Simple Geometrical Shapes on Python Using NumPy and Visualize It
Contents Drawing Simple Geometrical Shapes on Python from scratch, have you tried it?
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Gesture Based Visually Writing System Using OpenCV and Python
This is the first part of Gesture Based Visually Writing System. Gesture Based Visually Writing System Using OpenCV and Python Gesture Based Visually Wr...
Writing Popular Machine Learning Optimizers From Scratch on Python
Contents Before begining, 2. Contains 2.1 Initialize our class Gradient Descent 2.3 Momentum Optimizer 2.4 Adagrad 2.5...
Image Processing Class from Scratch on Python
Contents 1.1 What am I using? 1.2 What this blog includes? 2 Steps Initializing a ImageProcessing class Adding a read method Add...
Writing a Deep Neural Network from Scratch on Python
Contents Updates: 1.1 What I am covering on this blog? 2. Warning 3. Steps 3.1 Creating a FF layer class. 3.1.1 As usual, importing nece...
Text Classification using Naive Bayes, Scratch to the Framework
So this is not a blog for introduction to naive bayes but implementation way for spam message classification. I have also created a YouTube video for this t...
Project
Text Analysis with WordCloud in Python
WordCloud in Python can be done in different ways but one of the most popular and easier ones is using the package wordcloud. We can install it using the fol...
WorldCup Tweet Sentiment Analysis in Python
WorldCup tweet sentiment analysis will be done based on tweets related to the world cup.
Gesture Based Calculator
Gesture Based Calculator Hello and welcome everyone to our last project on the #7DaysOfComputerVisionProjects series where we did some cool computer vision p...
Game: Kill a Fly
Kill The Fly Hello surfer, if you were following our series #7DaysOfComputerVisionProjects then this is the 6th project and this is going to be different and...
Gesture Based Visually Writing System
Gesture Based Writing Method Introduction Hello surfer, welcome to this blog where I will be writing a Python code to write something in canvas by moving fin...
Auto Trex: Playing Chrome Trex Game with Image Processing
Playing Trex Game With Image Processing Hello everyone, in the last part, we used gestures to perform jump and duck but in this part, we will not use gesture...
Playing Chrome Trex Game with Gestures
Play Trex Game on Chrome By Gesture Using OpenCV and Mediapipe Hello there surfer! Since few days, I am thinking about some cool projects that can be done w...
Air Mouse: Controlling Mouse With Gestures in Air
Air Mouse: Doing Mouse Operations Using Finger Gestures Hey surfer, in this blog, I am going to write about how can we do basic mouse operations like move po...
Realtime Background Changing in Python
Real Time Background Changing With OpenCV and Python This blog is the part of the series #7DaysOfComputerVisionProjects. Links to the blogs and videos of eac...
Messing Up With Convolutional Neural Nets: Autoencoder for Grayscale to RGB Image
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff. Image colorization has recently been popular with the...
NEPSE Data Visualizing and Deploy it on Heroku
Introduction I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Corn Leaf Infection Detection: Data Preprocessing and Custom Datagenerator
Introduction Here on this blog, I will be giving a gentle introduction about how to do Region Based Detection project on python from scratch. The scratch mea...
Deploying Face Mask Classifier on Heroku: Train Classifier
This is a part 1 of a blogging series. Part 1: Deploying Face Mask Classifier on Heroku: Building a Classifier Part 2: Deploying Face Mask Classifier on...
OCR For Devanagari Handwritten Character: Building a Classifier
A Devanagari Handwritten Characters Classifier using CNN on Keras.
Contour Based Game: Break The Bricks
Contents
Drawing Simple Geometrical Shapes on Python Using NumPy and Visualize It
Contents Drawing Simple Geometrical Shapes on Python from scratch, have you tried it?
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Gesture Based Visually Writing System Using OpenCV and Python
This is the first part of Gesture Based Visually Writing System. Gesture Based Visually Writing System Using OpenCV and Python Gesture Based Visually Wr...
Building OCR For Devanagari Handwritten Character
Using Keras, OpenCv, Numpy build a simple OCR. Contents Inspiration Devanagari is popular across India and Nepal. It is also a National font of ...
Image Processing
Auto-encoders from Scratch in Python
Auto-encoders from scratch will be done over the concept of Neural Network from Scratch that I already did. You can find it on my following blogs. Feed Fo...
Deploying Image Manipulation Tool in Heroku
In this part, we explore Deploying Image Manipulation tool in Heroku because it is a cloud application platform which gives us the flexibility to deploy our ...
Building Image Merger Web Tool In Python
Image Merger tool is also useful just like the image size reducer tool. Lets take an example where is it needed, suppose we are about to fill some applicatio...
Building Image Size Reducer In Python
Image size reducer is much needed tool these days because most site wants us to upload various documents in the form of image but with the size limit. Modern...
Image Compression In Python: Huffman Encoding
Huffman Coding This blog will be completed with much more exercises on dataqoil.com.
Gesture Based Calculator
Gesture Based Calculator Hello and welcome everyone to our last project on the #7DaysOfComputerVisionProjects series where we did some cool computer vision p...
Game: Kill a Fly
Kill The Fly Hello surfer, if you were following our series #7DaysOfComputerVisionProjects then this is the 6th project and this is going to be different and...
Gesture Based Visually Writing System
Gesture Based Writing Method Introduction Hello surfer, welcome to this blog where I will be writing a Python code to write something in canvas by moving fin...
Auto Trex: Playing Chrome Trex Game with Image Processing
Playing Trex Game With Image Processing Hello everyone, in the last part, we used gestures to perform jump and duck but in this part, we will not use gesture...
Playing Chrome Trex Game with Gestures
Play Trex Game on Chrome By Gesture Using OpenCV and Mediapipe Hello there surfer! Since few days, I am thinking about some cool projects that can be done w...
Air Mouse: Controlling Mouse With Gestures in Air
Air Mouse: Doing Mouse Operations Using Finger Gestures Hey surfer, in this blog, I am going to write about how can we do basic mouse operations like move po...
Realtime Background Changing in Python
Real Time Background Changing With OpenCV and Python This blog is the part of the series #7DaysOfComputerVisionProjects. Links to the blogs and videos of eac...
Image Compression In Python: Run Length Encoding
Run Length Encoding is one of the image compression algorithms that is lossless. So let’s get started. (Teaser Image taken from here.) If you are intere...
Getting Started With OpenCV in C/C++ in Windows
How to configure OpenCV for C/C++ in Windows? Installing OpenCV is very hard task because of various things like build error and Compiler Error. So in this t...
Messing Up With Convolutional Neural Nets: Autoencoder for Grayscale to RGB Image
I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff. Image colorization has recently been popular with the...
Data Analysis
Python for Stock Market Analysis: Alpaca API
Introduction Alpaca Trading API is an API using which we can retrieve stock data in realtime. It provides various APIs and even streaming services. Please re...
Python for Stock Market Analysis: Getting Started into Modeling Timeseries
Introduction Hello there, this is the part 5 of Python for Stock Market Analysis and in this part, we will continue from where we left i.e. modeling a timese...
Python for Stock Market Analysis: Getting Started into Timeseries Analysis
Introduction This is the part 4 of our Python for Stock Market Analysis series and here, we will be getting started with timeseries analysis. This part will ...
Python for Stock Market Analysis: Growth Rates
Introduction Interactive plot version of blog is available at here.
Central Tendency vs Dispersion
Hello everyone, welcome back! In this blog we will again focus into the some of widely used central tendency techniques and then measure of spread in the Sta...
Python for Stock Market Analysis: Exploring Technical Trend Indicators
Introduction Hello and welcome back everyone to our second part of the new blog series Python for Stock Market Analysis. In the last part, we explored differ...
Python for Stock Market Analysis: Working with Moving Averages
Introduction This blog is a first part of our series Python for Stock Market Analysis.
Creating Awesome Data Dashboard with Plotly in Streamlit: Clustering
This is a continuation of our previous blog entitled as Creating Data Dashboards With Streamlit and Python.
Creating Awesome Data Dashboard with Plotly in Streamlit: EDA
Data Dashboards are getting highly popular because the need to get insights from data is getting increased. One of the few ways we find the insights from the...
Walkthrough of Statistical Analysis in Data Science
What is Statistical Analysis in Data Science?
Data Analysis and Importance of Groupby in Pandas but not Just pd.groupby
Data Analysis and Importance of Groupby in Pandas but not Just pd.groupby This blog will be continously updated as I find new ways, tricks to make things wor...
Python
Advent of Code 2022 with Python
The advent of Code is a yearly festival for programmers like me where we try to solve different stories to gain stars. I love these challenge because its fun...
Finding DateTime in Text Using Python
Why do we need to find DateTime in the text? In the field of data science, we often have to deal with various kinds of data and one of the common is Text dat...
Basics of Stock Backtesting in Python
Stock Backtesting in Python is way of testing our strategy in a historical data to see if our strategy makes any money or not. Let’s start with a simple stor...
Basics of Multi-threading in Python
Multi-threading in Python is often used when there are tasks related to I/O bound. But before going further, let’s take a few examples where multi-threading ...
Working with datetime in Python
Working with DateTime in Python can be a challenging job if we do not know the right module to do the right thing. Here we will explore some of the useful mo...
Intro to OpenCV for Image Processing with Python
OpenCV is a multi-platform Image Processing tool which provides lots of algorithms and processes. This notebook was written in 2019 by me when I was just lea...
Intro to CNN with Keras
CNN with Keras is easiest way to create CNN (Convolutional Neural Networks. But Why? Images I used in this blog are not owned by me and the full credit goes ...
Python Generators
Python Generators are kind of iterators which allows us to iterate through the values returned through the function using yield keyword. In simple words, gen...
SMTPlib: Send Emails with Python
Introduction Hello and welcome back everyone, in this blog we will be exploring how we can send emails using Python. We will be using SMTPlib.
Pyscript: Running Python in Webpages
Pyscript is a JS library that allows us to write and run Python code on HTML web pages. In this blog, we will explore PyScript for running Python codes insi...
Python Asyncio: Concurrent Programming
Introduction Async IO means Asynchronous I/O and it has been there since the Python 3.4. The main purpose of asyncio is to achieve Concurrency and Multiproce...
Machine Learning
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Writing Popular Machine Learning Optimizers From Scratch on Python
Contents Before begining, 2. Contains 2.1 Initialize our class Gradient Descent 2.3 Momentum Optimizer 2.4 Adagrad 2.5...
Image Processing Class from Scratch on Python
Contents 1.1 What am I using? 1.2 What this blog includes? 2 Steps Initializing a ImageProcessing class Adding a read method Add...
Writing a Deep Neural Network from Scratch on Python
Contents Updates: 1.1 What I am covering on this blog? 2. Warning 3. Steps 3.1 Creating a FF layer class. 3.1.1 As usual, importing nece...
Text Classification using Naive Bayes, Scratch to the Framework
So this is not a blog for introduction to naive bayes but implementation way for spam message classification. I have also created a YouTube video for this t...
Building OCR For Devanagari Handwritten Character
Using Keras, OpenCv, Numpy build a simple OCR. Contents Inspiration Devanagari is popular across India and Nepal. It is also a National font of ...
Crowd Counting Made Easy
Contents Experience Of Being Udacity Scholar: As a scholar of Udacity’s Secure and Private AI Challenge course by Facebook, I have not only learned abo...
Artificial Intelligence
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Writing Popular Machine Learning Optimizers From Scratch on Python
Contents Before begining, 2. Contains 2.1 Initialize our class Gradient Descent 2.3 Momentum Optimizer 2.4 Adagrad 2.5...
Image Processing Class from Scratch on Python
Contents 1.1 What am I using? 1.2 What this blog includes? 2 Steps Initializing a ImageProcessing class Adding a read method Add...
Writing a Deep Neural Network from Scratch on Python
Contents Updates: 1.1 What I am covering on this blog? 2. Warning 3. Steps 3.1 Creating a FF layer class. 3.1.1 As usual, importing nece...
Text Classification using Naive Bayes, Scratch to the Framework
So this is not a blog for introduction to naive bayes but implementation way for spam message classification. I have also created a YouTube video for this t...
Building OCR For Devanagari Handwritten Character
Using Keras, OpenCv, Numpy build a simple OCR. Contents Inspiration Devanagari is popular across India and Nepal. It is also a National font of ...
Crowd Counting Made Easy
Contents Experience Of Being Udacity Scholar: As a scholar of Udacity’s Secure and Private AI Challenge course by Facebook, I have not only learned abo...
Data Science
Taking Data Apps into WebApp: Using Streamlit, Plotly, and Python
Introduction From the past 2 stories of a data and its journey to confess the insights, we have explored several areas and to point out few: We have done ...
Beyond and Within EDA: Taking EDA into Modelling
Beyond and Within EDA
Tweet Scraping with Tweepy
Tweet Scraping can be done with different ways but one of the reliable ones is using Tweepy and Tweeter’s developer API. In this blog we are going to explore...
A General Way to Perform an EDA
Introduction Hello everyone, welcome back to another new blog where we will explore different ideas and concept one could perform while performing an EDA. In...
Building Machine Learning Apps Faster With dstack.ai
Building Machine Learning Apps Faster With dstack.ai Happy New Year everyone!
Building Data Apps Faster With dstack.ai
Getting Started With dstack.ai This blog contains a minimal example of making data apps using dstack.
NEPSE Data Visualizing and Deploy it on Heroku
Introduction I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Stock Market Analysis
Python for Stock Market Analysis: Alpaca API
Introduction Alpaca Trading API is an API using which we can retrieve stock data in realtime. It provides various APIs and even streaming services. Please re...
Python for Stock Market Analysis: Getting Started into Modeling Timeseries
Introduction Hello there, this is the part 5 of Python for Stock Market Analysis and in this part, we will continue from where we left i.e. modeling a timese...
Python for Stock Market Analysis: Getting Started into Timeseries Analysis
Introduction This is the part 4 of our Python for Stock Market Analysis series and here, we will be getting started with timeseries analysis. This part will ...
Python for Stock Market Analysis: Growth Rates
Introduction Interactive plot version of blog is available at here.
Python for Stock Market Analysis: Exploring Technical Trend Indicators
Introduction Hello and welcome back everyone to our second part of the new blog series Python for Stock Market Analysis. In the last part, we explored differ...
Python for Stock Market Analysis: Working with Moving Averages
Introduction This blog is a first part of our series Python for Stock Market Analysis.
Game Development
Contour Based Game: Break The Bricks
Contents
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Unity has provided 3 months of Unity Learning Premium free for all
Due to current global threat of COVID-19, unity is providing free access to all the contents of Unity Learn platform. And as a life long learner, I am wri...
Guidance For AI Game Development Using Unity
Contents As becoming a Machine Learning enthusiast, I searched for some resources where I can learn Reinforcement Learning. Then at the same time I found a...
apache airflow
Running Airflow in WSL but Using MySQL Server from Windows as Default
Introduction There are lots of benefit of using MySQL as a backend database in Airflow. Main reason is that MySQL is widely used in production instead of SQl...
Branching Tasks in Airflow
Branching Task in Airflow When do we need to make a branch like flow of a task?
Connecting to MySQL Server in Windows Machine from WSL
Connecting MySQL Server in Windows Machine from WSL What does this mean? In simple sentence, how do we connect to a MySQL server which is hosted in Windows f...
Dynamic Tasks in Airflow
This blog is a continuation of previous blog Getting Started With Airflow in WSL.
Running Airflow in Windows with WSL
Getting Started With Airflow in WSL This blog will be updated more on dataqoil.com.
data engineering
Running Airflow in WSL but Using MySQL Server from Windows as Default
Introduction There are lots of benefit of using MySQL as a backend database in Airflow. Main reason is that MySQL is widely used in production instead of SQl...
Branching Tasks in Airflow
Branching Task in Airflow When do we need to make a branch like flow of a task?
Connecting to MySQL Server in Windows Machine from WSL
Connecting MySQL Server in Windows Machine from WSL What does this mean? In simple sentence, how do we connect to a MySQL server which is hosted in Windows f...
Dynamic Tasks in Airflow
This blog is a continuation of previous blog Getting Started With Airflow in WSL.
Running Airflow in Windows with WSL
Getting Started With Airflow in WSL This blog will be updated more on dataqoil.com.
data pipelining
Running Airflow in WSL but Using MySQL Server from Windows as Default
Introduction There are lots of benefit of using MySQL as a backend database in Airflow. Main reason is that MySQL is widely used in production instead of SQl...
Branching Tasks in Airflow
Branching Task in Airflow When do we need to make a branch like flow of a task?
Connecting to MySQL Server in Windows Machine from WSL
Connecting MySQL Server in Windows Machine from WSL What does this mean? In simple sentence, how do we connect to a MySQL server which is hosted in Windows f...
Dynamic Tasks in Airflow
This blog is a continuation of previous blog Getting Started With Airflow in WSL.
Running Airflow in Windows with WSL
Getting Started With Airflow in WSL This blog will be updated more on dataqoil.com.
Projects
MySQL
MySQL Prepared Statements
MySQL Prepared Statements are the queries or statements they are prepared in a way that they can be used later on. They are complied while on creation and ca...
MySQL: Triggers
Triggers in SQL Triggers in SQL is a way to invoke something as a response to the events on the table in which Trigger is attached. The example of the event ...
Connecting to MySQL Server in Windows Machine from WSL
Connecting MySQL Server in Windows Machine from WSL What does this mean? In simple sentence, how do we connect to a MySQL server which is hosted in Windows f...
Technical Analysis
Python for Stock Market Analysis: Growth Rates
Introduction Interactive plot version of blog is available at here.
Python for Stock Market Analysis: Exploring Technical Trend Indicators
Introduction Hello and welcome back everyone to our second part of the new blog series Python for Stock Market Analysis. In the last part, we explored differ...
Python for Stock Market Analysis: Working with Moving Averages
Introduction This blog is a first part of our series Python for Stock Market Analysis.
EDA
Taking Data Apps into WebApp: Using Streamlit, Plotly, and Python
Introduction From the past 2 stories of a data and its journey to confess the insights, we have explored several areas and to point out few: We have done ...
Beyond and Within EDA: Taking EDA into Modelling
Beyond and Within EDA
A General Way to Perform an EDA
Introduction Hello everyone, welcome back to another new blog where we will explore different ideas and concept one could perform while performing an EDA. In...
Web App
Deploying Image Manipulation Tool in Heroku
In this part, we explore Deploying Image Manipulation tool in Heroku because it is a cloud application platform which gives us the flexibility to deploy our ...
Building Image Merger Web Tool In Python
Image Merger tool is also useful just like the image size reducer tool. Lets take an example where is it needed, suppose we are about to fill some applicatio...
Building Image Size Reducer In Python
Image size reducer is much needed tool these days because most site wants us to upload various documents in the form of image but with the size limit. Modern...
Games
Contour Based Game: Break The Bricks
Contents
Deploying a Simple RASA Chatbot on Unity3d Project to Make a Chatbot for Android Devices
Creating a Chatbot on Android Using Unity3d and RASA I might stop writing new blogs on this site so please visit dataqoil.com for more cool kinds of stuff.
Streamlit
Creating Awesome Data Dashboard with Plotly in Streamlit: Clustering
This is a continuation of our previous blog entitled as Creating Data Dashboards With Streamlit and Python.
Creating Awesome Data Dashboard with Plotly in Streamlit: EDA
Data Dashboards are getting highly popular because the need to get insights from data is getting increased. One of the few ways we find the insights from the...
Statistics
Central Tendency vs Dispersion
Hello everyone, welcome back! In this blog we will again focus into the some of widely used central tendency techniques and then measure of spread in the Sta...
Timeseries Analysis
Python for Stock Market Analysis: Getting Started into Modeling Timeseries
Introduction Hello there, this is the part 5 of Python for Stock Market Analysis and in this part, we will continue from where we left i.e. modeling a timese...
Python for Stock Market Analysis: Getting Started into Timeseries Analysis
Introduction This is the part 4 of our Python for Stock Market Analysis series and here, we will be getting started with timeseries analysis. This part will ...
Stock
Basics of Stock Backtesting in Python
Stock Backtesting in Python is way of testing our strategy in a historical data to see if our strategy makes any money or not. Let’s start with a simple stor...
Polygon.io for Stock Market Data
Introduction Hello everyone, welcome back to our new blog about getting Stock data in realtime using Polygon.io. Few blogs ago, I’ve shared how can we use Al...
urllib3
Making Weather Bot with Accuweather, OpenWeather and Twilio
To make a Weather Bot we are going to use Twilio, it is a platform which allows us to send SMS, make calls using methods like API calls. It was the beginning...
Making People Finder in 2022 Using BeautifulSoup
Introduction
CNN
Auto-encoders from Scratch in Python
Auto-encoders from scratch will be done over the concept of Neural Network from Scratch that I already did. You can find it on my following blogs. Feed Fo...
Intro to CNN with Keras
CNN with Keras is easiest way to create CNN (Convolutional Neural Networks. But Why? Images I used in this blog are not owned by me and the full credit goes ...
blog
Beginning of my blogging journey.
Contents I thought of doing blogging since school but guess what, the internet was not that much available like these days. After years, I am about to write...
Unity3D
Guidance For AI Game Development Using Unity
Contents As becoming a Machine Learning enthusiast, I searched for some resources where I can learn Reinforcement Learning. Then at the same time I found a...
Software
Back to Top ↑github-pages
Back to Top ↑Agriculture
Corn Leaf Infection Detection: Data Preprocessing and Custom Datagenerator
Introduction Here on this blog, I will be giving a gentle introduction about how to do Region Based Detection project on python from scratch. The scratch mea...
adventofcode
Back to Top ↑challenges
Back to Top ↑Pandas
Data Analysis and Importance of Groupby in Pandas but not Just pd.groupby
Data Analysis and Importance of Groupby in Pandas but not Just pd.groupby This blog will be continously updated as I find new ways, tricks to make things wor...
data visualization
Plotting interactive plots with Plotly and Cufflinks
Plotting High Quality Plots in Python with Plotly and Clufflinks
Julia
Installing Julia in Windows and Running in Jupyter Notebook
Installation of Julia First download the installer from official site then run the installer. Set the environvent path variable. Test it by opening th...
Clustering
Creating Awesome Data Dashboard with Plotly in Streamlit: Clustering
This is a continuation of our previous blog entitled as Creating Data Dashboards With Streamlit and Python.
mysql
Running Airflow in WSL but Using MySQL Server from Windows as Default
Introduction There are lots of benefit of using MySQL as a backend database in Airflow. Main reason is that MySQL is widely used in production instead of SQl...
Central Tendency vs Dispersion
Hello everyone, welcome back! In this blog we will again focus into the some of widely used central tendency techniques and then measure of spread in the Sta...
Central Tendency vs Dispersion
Hello everyone, welcome back! In this blog we will again focus into the some of widely used central tendency techniques and then measure of spread in the Sta...
ARIMA
Python for Stock Market Analysis: Getting Started into Modeling Timeseries
Introduction Hello there, this is the part 5 of Python for Stock Market Analysis and in this part, we will continue from where we left i.e. modeling a timese...
Probability
Back to Top ↑Alpaca API
Python for Stock Market Analysis: Alpaca API
Introduction Alpaca Trading API is an API using which we can retrieve stock data in realtime. It provides various APIs and even streaming services. Please re...
Concurrent Programming
Python Asyncio: Concurrent Programming
Introduction Async IO means Asynchronous I/O and it has been there since the Python 3.4. The main purpose of asyncio is to achieve Concurrency and Multiproce...
Asyncio
Python Asyncio: Concurrent Programming
Introduction Async IO means Asynchronous I/O and it has been there since the Python 3.4. The main purpose of asyncio is to achieve Concurrency and Multiproce...
Pyscript
Pyscript: Running Python in Webpages
Pyscript is a JS library that allows us to write and run Python code on HTML web pages. In this blog, we will explore PyScript for running Python codes insi...
Javascript
Pyscript: Running Python in Webpages
Pyscript is a JS library that allows us to write and run Python code on HTML web pages. In this blog, we will explore PyScript for running Python codes insi...
Triggers
MySQL: Triggers
Triggers in SQL Triggers in SQL is a way to invoke something as a response to the events on the table in which Trigger is attached. The example of the event ...
Tweets
Tweet Scraping with Tweepy
Tweet Scraping can be done with different ways but one of the reliable ones is using Tweepy and Tweeter’s developer API. In this blog we are going to explore...
Data Visualization
Getting Started with Apache Superset for Data Dashboards
Apache Superset is a very useful and easy-to-use visualization and dashboard-making tool that can be an alternative to tools like Tableau and PowerBI. In thi...
Apache Superset
Getting Started with Apache Superset for Data Dashboards
Apache Superset is a very useful and easy-to-use visualization and dashboard-making tool that can be an alternative to tools like Tableau and PowerBI. In thi...
SMTPlib
SMTPlib: Send Emails with Python
Introduction Hello and welcome back everyone, in this blog we will be exploring how we can send emails using Python. We will be using SMTPlib.
Polygon
Polygon.io for Stock Market Data
Introduction Hello everyone, welcome back to our new blog about getting Stock data in realtime using Polygon.io. Few blogs ago, I’ve shared how can we use Al...
streamlit
Back to Top ↑apache2
Back to Top ↑BeautifulSoup
Making People Finder in 2022 Using BeautifulSoup
Introduction
weather-bot
Making Weather Bot with Accuweather, OpenWeather and Twilio
To make a Weather Bot we are going to use Twilio, it is a platform which allows us to send SMS, make calls using methods like API calls. It was the beginning...
fractal
Making Fractal Shapes with Python
Fractals are the continuous and never ending patterns that can be seen in the nature. But its quite different than the classical geometry in the sense of con...
mathematics
Making Fractal Shapes with Python
Fractals are the continuous and never ending patterns that can be seen in the nature. But its quite different than the classical geometry in the sense of con...
OpenCV
Intro to OpenCV for Image Processing with Python
OpenCV is a multi-platform Image Processing tool which provides lots of algorithms and processes. This notebook was written in 2019 by me when I was just lea...
datetime
Working with datetime in Python
Working with DateTime in Python can be a challenging job if we do not know the right module to do the right thing. Here we will explore some of the useful mo...
multi-threading
Basics of Multi-threading in Python
Multi-threading in Python is often used when there are tasks related to I/O bound. But before going further, let’s take a few examples where multi-threading ...
Backtesting
Basics of Stock Backtesting in Python
Stock Backtesting in Python is way of testing our strategy in a historical data to see if our strategy makes any money or not. Let’s start with a simple stor...
DateTime
Finding DateTime in Text Using Python
Why do we need to find DateTime in the text? In the field of data science, we often have to deal with various kinds of data and one of the common is Text dat...
Text Processing
Finding DateTime in Text Using Python
Why do we need to find DateTime in the text? In the field of data science, we often have to deal with various kinds of data and one of the common is Text dat...
programming
Making Money with Programming
How much do you know about Making money with programming in this decade? It is getting broader and more expansive. With the availability of a wide range of i...
remote jobs
Finding Remote Jobs but How and Where?
Finding remote jobs might be troublesome work these days with too many jobs in the market but not finding the right one for your profile is. Here in this blo...
cryptography
Simple Cryptography Algorithms in Python
Cryptography Algorithms have been around the world for more than centuries and there are still many inscriptions around various places in the world which we ...
Challenge
Advent of Code 2022 with Python
The advent of Code is a yearly festival for programmers like me where we try to solve different stories to gain stars. I love these challenge because its fun...