/ Recent content on Scott's Random Data Blog Hugo -- gohugo.io en-us Sun, 06 Oct 2019 00:00:00 +0000 /2019/10/06/application-of-pca-with-music-features/ Sun, 06 Oct 2019 00:00:00 +0000 /2019/10/06/application-of-pca-with-music-features/ Some Context Principal Components Analysis (PCA) is a tool that goes back decades used widely to identify patterns in data. Once patterns are discovered, one can compress the data by reducing the number of dimensions without much loss of information. The objective is to transform a set of interrelated variables into a set of unrelated linear combinations of these variables. If one tries to apply PCA to a set of variables displaying low correlation, the analysis will most likely prove meaningless. /2019/09/22/text-generation-with-lstm-last-words/ Sun, 22 Sep 2019 00:00:00 +0000 /2019/09/22/text-generation-with-lstm-last-words/ Some Context I noticed around a year ago while writing an email using Gmail that the application was suggesting how I should finish a sentence. A similar feature was added in LinkedIn not too while ago suggesting phrases to use on messages. This piqued my interest and I started looking into how this was done and came across this amazing book by Francois Chollet and JJ Allaire which goes from basic theory to advanced practical applications on deep learning using the Keras framework (with Tensorflow as the backend engine). /2019/06/20/first-post-basic-webscraping/ Thu, 20 Jun 2019 00:00:00 +0000 /2019/06/20/first-post-basic-webscraping/ Some Context One day after work, I was messaging with a friend (who’s extremely curious about data and it’s applications and a source of great ideas) and we were talking about scraping data from the internet and what tools were currently available and most easy to learn. R and Python sprang to mind and so we deep dived into some of the packages available in those languages. Then, funnily enough, the conversation turned to VBA and crude methods such as using sendkeys and how unreliable they were. /2019/04/21/deconstructing-a-job-description-to-correctly-determine-the-industry/ Sun, 21 Apr 2019 00:00:00 +0000 /2019/04/21/deconstructing-a-job-description-to-correctly-determine-the-industry/ Some Context After reading this really good machine learning textbook by Brett Lantz, I was left wondering where I could use some of the techniques taught in the book for my personal use. Personally, when I search for jobs on websites like Seek, I tend to narrow my search to a specific role. The dangers with this is that, in recent times, data roles can go by many names. Different companies may use a different title for essentially the same role. /2018/10/13/test-network-graphs/ Sat, 13 Oct 2018 00:00:00 +0000 /2018/10/13/test-network-graphs/ I was working on the igraph package in R at work a couple of weeks ago and although it did the job, it lacked a bit of a visual presence. Here is a website full of igraph network graphs for your reference. Thought I’d have a look at D3 Network graphs. Looks promising thus far! Enjoying the interactivity of the nodes. It’s also very surprisingly easy to implement. /about/ Thu, 05 May 2016 21:48:51 -0700 /about/ Hi there, I’m Scott, currently working as a data analyst. I set this blog up to act as a repository for some of the interesting pieces of work that I do in my spare time and also to act as a quick resource for myself and others in my field for trivial tasks that can get easily forgotten in the details such as remembering the connection string used to connect to SQL server from a client software. /reference/ Wed, 04 May 2016 21:48:51 -0700 /reference/ Some useful references R for Data Science by Hadley Wickham Data Wrangling Cheatsheet by RStudio Data Visualisation with ggplot2 Cheatsheet by RStudio Regular Expressions in R Cheatsheet by RStudio You don’t know Javascript (YDKJS) Tableau Deep Dives by Robert Curtis (Interworks) Comprehensive Blog for R RShiny Articles More to come…