I wrote a little code to analyze technologies in demand with new startups. I used the AngelList job board as my source and was able to pull about 1100 startup job postings. AngelList shut down their API a while back. I created the data files from a simple jQuery selector, once I had manually loaded all of the posts they would allow. Note that this behavior caused my AngelList account to be flagged for scraping and disabled, and they won’t re-enable it.
This is by no means a scientific study. Part of my task was to normalize the data the best that I could, which is tricky. For example, Ruby is rarely used outside of Ruby on Rails. So, if I saw a job post for only Ruby, I grouped them in with the Ruby on Rails posts, which may or may not be fair. However, Python is widely used outside of Django, for example, so I kept those separate. There are similar normalization problems with AI and Data Engineering. People refer to them in a multitude of ways, that at a nuanced level are very different. For my purposes, many of these terms are related enough to group together. I very well may have gotten some of that wrong. The code is there for you to decide.
AngelList is largely centered around startups. There aren’t many large or established companies on there, though there are a few. This data is skewed and probably only applicable to US (largely Silicon Valley) based startups. Nonetheless, I still find it interesting, and I think there are a few takeaways.
React is winning the JS framework/library battle, at least for now, which corroborates my experience.
Ruby on Rails is still heavily used and in-demand. As a Ruby on Rails developer and fan, I was pleasantly surprised.
I thought there would be more Elm. I hear a lot of Elm talk, but it is conspicuously absent from the list.
AI and Data Engineering positions are now everywhere.
Java is still everywhere.
I would have thought there would be a bit more blockchain. Even if I had summed all blockchain related terms, it still wouldn’t be as high as I would have thought. News around price doesn’t correlate with jobs, I suppose.
Key - [Technology, number of job posts mentioning that technology]