Tuesday, August 18, 2009

Suck Us All Into the Machine: Build FluidDB on Twitter and #Hashtags

I was reading today about a fairly amorphous, tag-based, public "database" concept called FluidDB.

To avoid the usual distractions, I will assume my audience knows all about relational and non-relational datastores, implications of tag-oriented metadata, etc. In fact, since my friends know about this stuff and they are most of my audience, I think I'm not too far afield making this assumption.

One reason I found the FluidDB concept interesting is vanity: about four weeks ago, I spent some time considering building just this kind of database ... on top of Twitter.

Why would one want to do that?

Precisely because Twitter already has a lot of meaningful data curated by humans and tagged with a well-known metadata scheme (hashtags).

In exchange for having very small or hypernormalized data records (since each atomic entry is limited to 140 characters minus the tags and any indexed keys), we get a strange merging of human- and machine-readable data.

Humans could read (and follow, search, etc.) data entities of interest.

And clearly the "goal" of automated (machine) participants (clients) would be to understand as much of the human content as possible, treating it as objects, tuples, logical inferences, or knowledge base "facts."

Moreover, the originator of a tweet, as well as any @-referenced recipients, are critical metadata. They are, actually, tags themselves in way which is linearly independent of the hashtags. That is, a from-@adbreind tweet (entity) marked #database is different from a to/ref-@adbreind tweet marked #database, while #database must be considered to (possibly) have a different sense than it does in, say, a from-@headius tweet. However, the same tools and semantic analyzers can be applied, essentially treating the writer and target of a tweet as special tags.

In this way, our twitter discourse, short enough to make machine understanding tempting even when the packed cultural references make such understanding impractical, merges us into the database and makes us "just another part of the machine."


Anonymous said...

















ally said...

Fashion is all about lookingmoncler jackets good and being comfortable at the same time. monclermoncler coatsEvery woman loves being complimentedmoncler t-shirtmoncler vestmoncler outlet for her sense of style and elegance. ugg bootscheap ugg bootsdiscount ugg bootsNo woman wants to be labeled as outdated and old fashioned.ugg classic tall bootsclassic ugg bootsWomen are expected to be in constant touch with the latest trends in ordermoncler jacketsmonclernew moncler coats to adopt those trends and look fashionable and stylish. moncler vestmoncler outletmoncler polo t-shirtWomen need to make sure that whatever they wear, coach outletcoach handbagscoach bagsit should compliment their personality and they do not feel awkward while wearing it. coach totescoach outletlouis vuitton handbagsAn article about Gothic costume clothing and the importance of choosing Gothic choker. LV handbags 2010Louis Vuitton bagsLouis Vuitton totesThis article explores the wide variety of Gothicrain boots
rainweardiesel jeans chokers available from everyday to special occasions. Ture Religion Jeanslevis jeansabercrombie and fitch outletIt should inspire people to go shopping for their own Gothic chokers. ed hardy wholesaleed hardy outletcheap ed hardy wholesaleThe origins of the Flat cap span discount ed hardy wholesalewholesale ed hardy

gaohui said...

The holidays are a time ed hardy of getting together with friends ed hardy shoes and family, attending elaborate ed hardy clothing parties, and other exciting events ed hardy clothes that involves dressing up in stunning ed hardy store wardrobes. If you ed hardy Bikini are pregnant during ed hardy swimsuits the holidays, it does not ed hardy Caps mean that you are unable buy ed hardy to look fabulous and ed hardy swimwear stylish. Now, an expectant ed hardy sale mother has many styles of chic ed hardy glasses maternity clothing that allows cheap ed hardy her to show off her baby bump Christian audigier while looking spectacular.

xinag zhong said...

In this way, our twitter discourse, Buy rs goldshort enough to produce appliance understanding tempting even once the packed social references make this kind of understanding impractical, merges us to the data provide and generates us "justCheapest Diablo 3 gold still another part in the machine."

Wanda Ackley said...


Anonymous said...

Ya ya whatever, feel free to do whatever you want to do....

buy cheap wow gold

iPad POS said...

I would really admire the work and efforts you did to make this blog wonderful and spectacular thanks keep post I wanted to write a quick note to express my thanks. I’m really impressed by a blog unique and perfectly chosen and organized!

Texas attorney Joe Garza said...

Thanks for taking the time to discuss that, I really feel strongly about it and love learning more on that topic. If achievable, as you gain competence, would you mind updating your blog with more information? It is highly helpful for me

automaty do gier online said...

I have to say I am very impressed with the efficient website and your posts are so informative.

mobogenie baixar said...

This is wonderful. This is precisely the article I needed to read today
i like play game jogos click online free and apply baixar facebook gratis online free and apply mobogenie baixar online free

friv4school 2016 said...

Obrigado sinceramente por compartilhar o que sabe e ser você mesmo.
yoop games |
friv4school 2016 |
game 7 vien ngoc rong |
game naruto quyet dau
quando o tratamento desses dados for efectuado por um profissional de saúde obrigado ao sigilo profissional ou por outra pessoa igualmente sujeita a uma obrigação de sigilo equivalente.

Giải Trí Tổng Hợp said...

Welcomes to google terminal from Austin Texas! google snake
Amazing insight you have on this, Happy wheels it's nice to find a website that details so much information about different artists... Age of war 2 This article always blew me... Earn to die For how many times I have read this.
slither io Hi! I’ve been reading your blog for a while slitherio it's nice to find a website that details so much big farm

Friv4 Games Online said...

great post. i like it. feeling great when reading your post. Keep on posting!
happy wheels | friv | girlsgogames | games2girls | happy wheels

Jasmine Thompson said...

Chaos Faction 4 with 29 weapons, 18 characters, 15 levels, 14 months in the making... the best games you will like its, have fun! Super mechs hacked is a turn-based online strategy multiplayer game where you build your very own mech and use it to dominate your opponents, be they A.I. or other players like yourself! Mahjong free games online is a puzzle game based on the same tiles. The goal is to match open pairs of identical tiles and remove them from the board, exposing the tiles under them for play

Drag Racer V3 said...

Your post is so nice www.whatsappbaixargratis.com.br

Alice Taylor said...

I understand what you bring it very meaningful and useful, thanks.


Hà Nguyễn said...

This is also a very good post which I really enjoyed reading. It is not everyday that I have the possibility to see something

Thu Lê said...

I was very impressed by this post, this site has always been pleasant news. Thank you very much for such an interesting post. Keep working, great job! In my free time, I like play game: superfighters2.net. What about you?

Candy Sim said...

The article you have shared here very good. This is really interesting information for me. Thanks for sharing!
hotmail.com login |hotmail log out |gmail login

ngocanhng said...

Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one. Just thought that I would post and let you know. Nice! thank you so much! Thank you for sharing.