Tag Archives: Big Data

Optimization: 100x performance boost (even without DevOps!) :-)

(First of all, apologies for the mention of ‘DevOps’ above:this post has, as far as I can tell – since I really don’t know what DevOps is, haven’t found any place where to download it… – nothing what so ever … Continue reading

Posted in development, Math, software | Tagged , , , , , , | 1 Comment

Feeling like God – understanding the design in detail, but not the outcomes: Neural Networks

(First of all, to clarify any potential for misunderstandings: I’m not religious, I do not believe in an almighty God – for that to happen, the teodice problem should have a clear and understandable solution, among other things…) Ok, back … Continue reading

Posted in Complex Systems, development, Math, Non Linear Dynamic Systems, software, Systems, Technology | Tagged , , , , , , , , , | Leave a comment

Neural networks and image recognition – hit rate for target detection

In my previous post, I described some experiments with neural networks and image recognition that I entertained myself with during xmas holidays.  Basically, I wanted to see if I could create a neural network process that, given tiny (10×10, that … Continue reading

Posted in Big Data, Complex Systems, development, Math, Non Linear Dynamic Systems | Tagged , , , , , , , , , | 2 Comments

Totalitarianism and loss of privacy in the surveillance state – government wet dream

A great scenario from aclu.org on what the future, for each of us,  in a totalitarian surveillance state will look like – every step you’ve taken, every person you’ve communicated with, every position you been at, every purchase you’ve made, … Continue reading

Posted in Big Data, Big Government, Systems, Technology | Tagged , , , , , | Leave a comment

Twitter buzz about IBM Rational

Having created a Python program for “poor man’s mass surveillance”, that given a Twitter account, or set of accounts, grabs the latest tweets from that account and analyzes each tweet for mentions, I thought it might be interesting to see … Continue reading

Posted in Big Data, development, SNA | Tagged , , , | Leave a comment

Poor man’s mass surveillance:collection & analysis of Twitter data with Gephi & Python

[Each of the “dots” in the graphs above –  there are about 100.000 of them –  even the tiniest small ones barely visible at this level of zoom, represents a twitter user (blue dot), or a hashtag (red dot).  The … Continue reading

Posted in Big Data, development, SNA, Surveillance | Tagged , , , , , | Leave a comment

Artistic Twitter social network graphs by Gephi

The above image contains almost 100.000 nodes, extracted from my Twitter relationships (transitively, of course, I’m not the Lady Gaga of  social networking, after all…! 😉 The above image was obtained by allowing Gephi to execute its Force Atlas 3D … Continue reading

Posted in Big Data, development, software | Tagged , , , , , | 2 Comments

Social Network analysis of Carl Bildt’s – Swedish Foreign Minister – Twitter activities

As I’ve posted before, the Swedish Foreign Minister Carl Bildt is very active on social media since long time (cudos, Carl!), as well as a proponent of close cooperation with foreign (read NATO + Israeli) security and intelligence services. Furthermore, … Continue reading

Posted in development, SNA, Surveillance | Tagged , , , | Leave a comment

Who has most influence within your network…?

Whether you are a leader, manager, coach, politician or dreaded marketeer, you would want to know who or which persons are the most influencial within your network, regardless of that network being a social or professional one. I just analyzed … Continue reading

Posted in Big Data | Tagged , | Leave a comment

Analysis of Twitter: relationships between tweeters, mentions and hashtags

Now things start to get really exiting: I extended my Python hack to collect information on all relationships for a set of Twitter users, more specifically, I record the following: Each tweeter becomes a node Each #hashtag becomes a node … Continue reading

Posted in Big Data, SNA, Surveillance | Tagged , , , , | Leave a comment