Posts

Showing posts with the label Gephi

downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Post a Comment
Read more

Social network analysis with Gephi

Image
Social Network Analysis or (SNA) is one of the most powerful tools available in the Social Sciences today. It allows to identify key players in a system, find structural holes and many other aspects of a society which are less accessible without the network paradigm. Gephi is an opensource package written in Java which is aimed at performing SNA. I came upon this in the recommendation of the new Coursera course on SNA . Gephi was selected due to its many features, because it is free software and since it cross platform. Another of it its advantages is in visualization. Here is an image of a classical data-set showing the dining school partners. This is a directed graph with 26 vertecies and 52 nodes indicating each girl's top two preferences for a dinner partner. The data was collected circa 1905 and published in the 1950. The outgoing degree is therefore 2 but the incoming degree varies from 1 to 6 showing that some girls (Eva an...
Post a Comment
Read more

Popular posts from this blog

downloading folders from google drive.

I wanted to download some course material on RL shared by the author via Google drive using the command line.  I got a bunch of stuff using wget a folder in google drive was a challenge. I looked it up in SO which gave me a hint but no solution. I installed gdown using pip and then used: gdown --folder --continue https://drive.google.com/drive/folders/1V9jAShWpccLvByv5S1DuOzo6GVvzd4LV if there are more than 50 files you need to use --remaining-ok and only get the first 50. In such a case its best to download using the folder using the UI and decompress locally. Decompressing from the command line created errors related to unicode but using the mac UI I decompressed without a glitch.
Read more

Random Thoughts on Linear Regressions

Regression Analysis TLDR Regression is the oldest and most powerful tool in a data scientist's toolbox. Under ideal conditions multiple linear regression would be the best and only tool a data scientist would want to use... In reality you would use a modern nonparametric variant or a different algorithm. Still, the main ideas I . discuss here  will pop up in many other models and algorithms. This post is my brain dump on regression - I'll update it as time allows to cover the many aspects of this technique.
Read more

Big Data Analytics Israel - New Year, New Data Scientist Job: 5 Things To Think About

Image
Data science interviews can be over whelming  New Year, New Data Scientist Job: 5 Things To Think About My notes: https://www.meetup.com/Big-Data-Analytics-Israel/events/253124286/ The first talk was by: Raya Belinsky -  "New job - yes or no?" The talk about finding your next job or reinventing your current jobs. Miss Belinsky's humour and background as an executive life-coach made this talk both pleasant and worth-while. She covered her operational definition of job burnout Linkin profile - complete the profile (it tells you what to do) The CV - ask 2 people to prepare it The Interview - e.g. prepare 3 questions Each had at least a couple of points worth taking care of in your next round of job search. Check out the talk and slides when they go online. Second talks by: Nathaniel Shimoni - "Life story" Mr Shimoni is an experienced story and had a compelling story to tell and his own twiting path to  becoming  a da...
Read more