How we found the rudest cities in the world – Analytics @ foursquare

With over 400 million check-ins in the last year, it’s safe to say that our servers log a lot of data. We use that data to do a lot of interesting analysis, from finding the most popular local bars in any city, to recommending people you might know, and even for drawing pretty pictures. However, until recently, our data was only stored in production databases and log files. Most of the time this was fine, but whenever someone non-technical wanted to do some data exploration, it required them knowing scala and being able to query against production databases.

This has become a larger problem as of late, as many of our business development managers, venue specialists, and upper management eggheads need access to the data in order to inform some important decisions. For example, which venues are fakes or duplicates (so we can delete them), what areas of the country are drawn to which kinds of venues (so we can help them promote themselves), and what are the demographics of our users in Belgium (so we can surface useful information)?

In short, without easy access to this data, we are not able to make smart decisions at any level of the company.

Thus we needed two things:

  1. A set of high-level scheduled reports to inform general business decisions.
  2. A way for anyone in the company to do data-exploration without hurting our production systems or learning about scala, sbt, ssh, and mongo.

The Solution

We decided to use Apache Hadoop, and Apache Hive in combination with a custom data server (built in Ruby), all running in Amazon EC2.

For those who don’t know, Hadoop is an open-source Map-Reduce framework for parallel data processing, and Hive is a secondary service that allows you to interact with Hadoop by defining ‘virtual’ tables and using familiar SQL syntax.

The data server is built using Rails, MongoDB, Redis, and Resque and communicates with Hive using the ruby Thrift client.

We all like pictures, so here is a diagram:

The idea is simple: we run our own ‘data server’ to act as a gateway to reports. This allows us to:

  • Provide an easy-to-use end-point to run data exploration queries (using SQL and simple web-forms).
  • Cache the results of queries (in a database) to power reports, so that the data is available to everyone, whenever it is needed.
  • Allow our hadoop cluster to be totally dynamic without having to move data around (we shut it down at night and on weekends).
  • Add new data in a simple way (just put it in Amazon S3!).
  • Analyse data from several data sources (mongodb, postgres, log-files).

Importing Data

The last two points are very important. In fact a large portion of the data-server’s code base is dedicated to data cleaning and importing. We found it best to represent all data in tab-delimited flat files. To turn mongo/log/postgres/json data into this format, each ‘table’ has a specification written in ruby. Here is a simple example:

class Checkin < Foursquare::MappedClass
    include Foursquare::LocationLookup
    mapped_attributes :id, :venue, :shout, :lat, :long
    mapped_attributes :country, :state, :timezone
end
data = “{
    id: ‘123’,
    venue: ‘456’,
    shout: ‘ayup mum!’,
    ll:’24.5,-50.4’,
    something_else: ‘boo!’
}
checkin = Checkin.new(data)

So now:

puts checkin.to_tab_delimited
=>    123    456    ayup mum!    24.5    -50.4    us    New York    America/New_York

The initialize method provided by Foursquare::MappedClass can interpret several data types, in this example JSON is used. By including the LocationLookup module, country, state, and timezone can be automatically added if a lat/long field exists (using a local Mongodb database). For all such transformations, tabs, newlines, and excess white-space are removed from field values to ensure that each record occupies only a single line.

We have rake tasks to run this as either a simple script, or as part of a hadoop streaming job.

Running Queries

Because we’re storing data away from the production system, we can run queries that generate 1,000,000,000,000 records if they want to (I’m looking at you @injust), and the system simply emails them a link to their results when the query has finished (so they don’t have to wait around). In fact we can run all sorts of cool stats.

A Fun Example

Lets say we want to find the city with the rudest citizens, judged by how often a tip left in that city contains a curse word. We could run this query:

SELECT
    v.city,
    v.state,
    sum(curse) AS curses,
    sum(any) AS any_tip,
    sum(curse)/sum(any) AS percentage
FROM
    (
    SELECT
        venueid,
        IF(text LIKE ‘%curseword_here%’, 1, 0) AS curse,
        1 AS any
    FROM tips
    ) tips
JOIN venues v ON tips.venueid = v.id
GROUP BY v.city, v.state
SORT BY percentage DESC

After 5 minutes of waiting, we have a list of top 20 offenders (highest % of tips containing curse words):

(I’ve filtered out cities that had less than 1000 tips total.)
Its good to see that the Mancunians truly are not only the rudest people in the UK, but the rudest people globally, only El Paso comes close. Although please keep in mind that this only evaluates the rudeness of English speaking countries (like that would make a difference?).

In Summary

Amazon’s Elastic MapReduce plus a simple Ruby on Rails server can make a powerful (and cheap) data analysis tool. By reducing the barrier to data-exploration we have been able to inform better business decisions, and even create a little fun.

- Matthew Rathbone, Foursquare Engineer (and a proud British midlander)

  • Anony

    Well that’s just f%&^ing brilliant.

  • http://twitter.com/istanbul istanbul

    Where is Istanbul? :)

  • Liz

    Interesting! Also absolutely no surprise that two South Florida cities make this list. :(

  • http://twitter.com/samhickmann Sam Hickmann ✔

    Thanks for sharing this.

  • http://twitter.com/daltonc Dalton Caldwell

    As a born-and-raised El Pasoan, I condone this f#$##)g message

  • http://twitter.com/daltonc Dalton Caldwell

    As a born-and-raised El Pasoan, I condone this f#$##)g message

  • http://twitter.com/daltonc Dalton Caldwell

    As a born-and-raised El Pasoan, I condone this f#$##)g message

  • http://twitter.com/largevoid Large Void

    Is this weighted by number of tips? … most cuss words per capita, per se.

  • James Iry

    Turkey.

  • http://technicalfault.net Anonymous

    Curious. What are your list of curse words?

  • Andyparos

    My fucking arse.

  • http://twitter.com/nbot2k nbot2k

    I guess that means nobody uses Foursquare in Paris then.

  • http://twitter.com/tuhinkumar Tuhin Kumar

    What exactly did you use for the language processing and taking into account native slangs?
    I am sorry but getting the data crunching is one part of the problem, the other is taking into account non english speaking cases as well. Sorry if I am missing the point here.

  • Jacoliame

    As a Mancunian I find your results a total load of crap. You could not run an analytical analysis correctly. You need to get your fat arse’s over here and actually meet the people.
    A more polite and friendly crowd you could wish to meet. We take no shit from jumped up computer programmers that do not know their arse from their elbow.. Try going to Belgium if you want to know what rudeness is. Tossers !

  • Optimanc

    “‘They return the love around here, don’t they?’ – Guy Garvey on Manchester”.

    I couldn’t start to count the number of times I hear from REAL PEOPLE with REAL LIVES in the REAL WORLD how warm and welcoming a place Manchester is.

  • http://twitter.com/RaelinM Raelin Musuraca

    As a Pittsburgher this is incredibly insulting. Swearing does not equal rudeness. Swearing is often used, to quote Sponge Bob, as a “sentence enhancer,” as in – “That was the best f@ck!ng sushi I ever had.” Please reveal a little more about your data analysis… what words did you look for? Did you consider context? Given that Pittsburgh was just declared the best place to live in the US — from a global perspective — I seriously question whether we are the rudest. “Pittsburgh is best place to live…” says Economist Intelligence Unit | Mail Online http://bit.ly/h6UMiB

    PS And if tweets from the Super Bowl were also included – that skews the entire analysis now, doesn’t it?

  • http://www.imgd.co.uk/ Design Multimedia Graphics

    Yea I wouldn’t mind seeing the list of curse words…
    Ok I haven’t read every single word in the article, but are these results relative to the activity in those cities or purely based on the number of curse words?

  • http://twitter.com/CheShA Cristian

    Your headline is not exactly a fair spin on the story, and I think it’s horrendously short sighted of you to define such a fine and friendly city, on a globally powerful blog such as this, as “rude”, based on such a simple and misrepresentative metric.

    You could have put anmy kind of spin on this, but instead, you chose to define a city that is renowned for its friendly and inclusive populace as “rude”, turning what could have been a fun article into an insult.

  • http://twitter.com/rathboma Matthew Rathbone

    Hey, I have family + friends who live in manchester. My personal affiliation with the city made these results all the more funny.

  • http://twitter.com/rathboma Matthew Rathbone

    Relative to the activity, its a % of the total tips left for the city.

  • Kitty

    Ah come on, it’s just a bit of fun. We Mancunians are a friendly bunch, there’s no disputing that, but I have to admit I do hear/see a helluva lot of cursing!

  • http://www.joesiewert.com Anonymous

    Interesting implementation. How long did it take to build? Will it scale nicely as the foursquare data sets continue to grow?

  • EilidhEggs

    I live in Manchester and it is fair to say I am offended on a regular basis!

  • http://twitter.com/keithandbrown Keith Brown

    Simply brilliant!

  • Matt

    Oh yeah, well f*ck you!! Just trying to make you feel at home! :)

    /proud to be an a**hole from El Paso

  • Tony Ramos

    I do think the headline was a misnomer. Certainly, there’s a lot do cursing going on, but that does not equate rudeness. One of the things we pride ourselves in El Paso is our friendliness. Many of my out of town guests have also commented on how friendly we are. So, cursing, YES, Rude, Nahh!

  • Al

    I just moved to El Paso from San Francisco and for you to say that El Paso is the second rudest city in the world, you must be “NUTS” you are identicle to Mens Health Magazine, just a bunch of biased prejiduce idiots.
    Foursqaure Engineering sounds pretty tacky and lame to me, what kind of drugs are you boys on?

  • Al

    Besides who cares what you may think of El Paso, most people that make negative comments about do so only because they are racist.
    Those that do know El Paso by heart know that El Paso is one of the most freindliest cities in the world and the freindliest in Texas. Manchester who?

  • Komark

    Failure to take in local culture is a big error.

  • Elpasorocks

    thats because everyone in el paso loves to check in while taking a shit!!!!

  • ElPasoAhole

    “Although please keep in mind that this only evaluates the rudeness of English speaking countries (like that would make a difference?).” 70% of the El Paso population is bilingual…..we are number 1!!!!!!!!!!!! i demmand a recount!!! hell ill give you a list of curse words in spanish to add on the query list…. EL PASO #1

  • Thechooz

    And who the &^%%@##! cares what Foursquare thinks?

    Greetings from El Paso, the most &^^$#%%$ friendly city in the world

  • the cyclist riding around town

    Lol el pasoans are now the fattest, sweatiest, unhealthiest bunch of rude jerks! I must agree, this city is full of angry pissed off fat a$$e$… Hahaha

  • Magic4life88

    Why are we always in fucking second place?

  • http://twitter.com/jjmullz Jonathan Mulligan

    Surely you need to take into account the relative offence curse words are deemed to cause in each city. A cheeky curse word in Manc might equate to outrage elsewhere.

  • http://twitter.com/jjmullz Jonathan Mulligan

    Surely you need to take into account the relative offence curse words are deemed to cause in each city. A cheeky curse word in Manc might equate to outrage elsewhere.

  • Soooofedup

    stop bragging about your mother!

  • Iraq Vet

    I’ve lived in El Paso for 5 years now, and I agree. I’ve lived in Korea, Germany, and many places in the U.S. The people here in El Paso are so @#%^*! rude I can’t even believe it. I should also mention, people in El Paso drive like $#@! I think they took out the “using your turn signal” portion of the driving test here.

  • Rachel Juliet

    I LOVE EL PASO!!!!!!!!!! People from El Paso are real.. . Don’t Mess With Texas!!!!!!

  • http://twitter.com/twoze Mark Ciccarello

    Yeah, you sound very polite.

  • http://www.facebook.com/people/Mary-R-Canfield/1566894286 Mary R. Canfield

    El Paso is my hometown, and I think it is one of the friendliest towns. Saying swear words is not the same as being rude, so I think it’s an unfair title!

  • Coco

    Are you stoned or just stupid? El Paso host the Sun Bowl every year. And, the players and the fans are always happy to be here.

  • F4Square

    hey foursquare go fuck yourself
    love el paso

  • Ercaluc

    ok well first of all… for this “scientific” study…. who is your sample??? what site were these tips left on? are repeat tippers filtered out? could this data say that people from el paso who use this site are rude or perhaps that 100 people from el paso are rude and leave a lot of tips???

    could it be suggested that El Pasoans use a lot of curse words?
    maybe it proves that people from El Paso are not rude in person so they have a virtual personality which curses???…………..

    Saying that you found the rudest people was not a very well thought out statement

  • Ercaluc

    oh and another thing…. you said rudest cities in the world…. oh wait, just english speaking cities…. where did you go to school?? seriously

  • Jacoliame

    Mark. You don’t do ironic humour do you ?.

    Sorry if I offended anyone.

    Love from Manchester.

  • http://www.facebook.com/nickrovisa Nick Rovisa

    Interesting. Thought Boston would be much higher.

  • Lucky109charms

    Bwahahahaa!! WTFuck?!

  • Erodrigz

    Maybe people in El Paso use more curse words in a casual sense than other places? Does this constitute rudeness? “I f**king love this place!”, “Best go**amn service ever!”, “The food is F**king incredible”.

  • Erodrigz

    This article is more of a how to query Foursquare’s database than it is an expliantion of the legitamcy to their claims. Manchester, El Paso and Pittsburgh should sue for defamation and slander.

  • http://www.facebook.com/people/Benny-Johnson/1449037243 Benny Johnson

    For anyone who haven’t been to El Paso don’t know what they are talking about. I’m a soldier and I was stationed in El Paso for almost 2 years and I can tell you the people of El Paso were Great!!!! I had a wonderful time there and I plan on going back to visit. El Paso treats the military community very well and I recommend to everyone I talk to to visit El Paso and while your are there please go to Carlos and Mickeys and eat some of the best mexican food I know of.

  • Graveler

    Interesting that in a city that is predominantly Hispanic that the survey was limited to English only? I’ve lived in El Paso all my life and to this day people I interact with daily are polite and courteous, to include having doors opened or held for me….just common courtesy. Rude? I beg to differ.

  • James Ny71

    I think El Paso sucks…people are so F##@@@ rude….I went shopping there and they all speak to you in Spanish…..This is USA speak english fookers….

  • James Ny71

    Mary you can take El Paso and shove it up your fat arse……seems like your a fooking fool….You must speak Spanish…..what a dirty city with nothing to do…..

  • Atlfalcon757

    Atlanta is the rudest city in the world..i live in Atlanta..Seattle is one of the most polite and open minded city in the country..and the most beautiful!!

  • tony rivas

    Get to work fat ass tony ramos, dont be using company time to post your bullshit

  • http://pulse.yahoo.com/_WLKB2L6WOZH7EFBOVPOTOS2ZEY jerry d

    Just stay out of Juarez….

  • Effyou

    You bitch ass lying motherfuckers! El Paso is the godddamn king of curse word using sons of bitches, fuck England and those limey motherfuckers!

  • Spic

    Absolutely!!! Emputado,envergado,hijo de puta, pinche madre, chinga tumadre!

  • Sfqueerz

    fuck you faggot!

  • 911goodjob

    I liked your response until I realized….you are from New York?? Stick NY up your fat donkey dick sucking sperm- gobbling mother’s ass. You New Yorkers are shit stains on the underwear of mankind. You can now go back to giving your Doberman a rim job, you fucking sperm guzzling asshole. Have a nice day:)

  • Guest

    I think there is a flaw on your system. I went over the tips left regarding El Paso and there was only one negative tip. All the others were positive (even if a bad word was added to emphasize how great the place was).

  • Guest

    Fookers? O_o Isn’t this the second comment you’ve done bashing El Paso? Before you talk, El Paso is a BORDER TOWN that is RIGHT NEXT TO JUAREZ, MEXICO! So how do you expect people not to speak Spanish?! Just because you don’t understand the language doesn’t mean that you’re better than it. Besides, more than half the population in El Paso is Hispanic, does that give you a hint to why “they all speak to you in Spanish”? Pendejo…>:)

  • Mlite

    What a crock of fucking shit

  • Anonymous

    …if you have a reason to stay out of there…? How did Juarez even get into this, we’re talking about El Paso, not Juarez. They are two different cities! In two different countries! And besides, the only reason you need to stay out of Juarez is if you’re affiliated with drugs. I’ve been there PLENTY of times to visit my family and nothing has ever happened to me.

  • DetroitMichigan

    Hooray! For once, Detroit is NOT on a ‘worst of’ or ‘most awful’ list!

  • Frustrated

    How is that funny…? Weirdo. And for the record, none of what you’re saying is legit.

  • Misleading

    This stupid thing is sooooo misleading…how can you base rude citizens on curse words? Rude and un-mannered are two different things. *Smh*

  • Duh

    There are so many flaws to this “query” that it’s ridiculous.

  • Blue10blue1062

    You all fool of shit.

  • Guest

    I’d like to know what people you encounter…cause I only occasionally bump into rude people. But what do you expect, no city is perfect. And “I should also mention” that many of the people that “drive like $#@!” have license plates from other states that are not Texas. And this query has SO many flaws that it’s ridiculous. Just food for thought…

  • guest

    *sarcasm* Wow…what a brilliant response.

  • Lsg5012

    This is BS

  • Lsg5012

    Pittsburgh is one of the friendliest cities in the US…people say to me all the time that they can’t believe how friendly the people are here

  • Lsg5012

    Pittsburgh was also recently voted as one of the most charitable cities in the US

  • Aimeesaldi

    I am a native El Pasoan and I currently live in the DC metro area and know that this may sound bias but when I moved here, people were so rude AND still are. People from El Paso have the most hospitable attitudes to people visiting or new to the area. People here in DC always question why are you nice to them or you have a motive with your kindness. I don’t know how you go your results but remember that to error is human but to BS only digs your own grave for failure. I am sure you have never visited the city yourself.

  • http://www.facebook.com/profile.php?id=1325885572 Indie Motorboatz

    Hell Yeah!

  • Revbillcobb

    I been here about five years, and have lived in other parts of Texas, California, Wisconsin, and Massachusetts. This is absolutely the friendliest city I have ever lived in!

  • http://www.facebook.com/profile.php?id=1325885572 Indie Motorboatz

    Back on topic, people. We were discussing El Paso….

    hehehehehehe

  • http://www.facebook.com/profile.php?id=1325885572 Indie Motorboatz

    i wish I could “like” this more than once!

  • Nuitgoddess

    Have lived in both Portland, Oregon and Boca Raton, Florida. There is absolutely NO WAY that Portland has people more rude that Boca! For example, Portland rates number one in polite drivers, driving in Boca is terrifying!
    Cannot wait to return to the nice people in Portland.

  • http://moolave.tk/ Fred T

    cee-lo has got to have a say on this

  • Thanksfucker

    Son Of A Bitch. All this time i thought “Thanks Fucker” was a polite phrase.

  • http://twitter.com/jordanjlloyd Jordan J. Lloyd

    70% of Mancunians are also bilingual – they speak English and Mancunian. So if you ran the numbers again, Manchester still comes out on top.

  • Sobrienc

    what a dumb statement,license plates from other states?, really. my own nabor flipped me off because i was going the speed limit, and he was in a hurry. how do you like the third lane on i10, they go 45 in a 60,wont move over until there exit is 10 feet away, then stop on the freeway and try to take that exit, and i swear it was a texas plate.

  • Drjr3610

    Who ever did this survey obviously did not go to France, if you want to see the rudest peopl in the world just go to France.

  • Just Peachy

    I think ALL of South Florida is rude!!! I should know, I live down here in this pit they call paradise! The Northerners and illegals have ruined South Florida! There should be more NY cities on this list. I’ve travel to many places and Eastern New Yorkers on the are the rudest people I’ve ever met!

  • BTown_Lady

    As someone who lives in Bloomington, I have to point out that 1) It’s a college town and there is bound to be an abundance of swearing and that 2) Despite being a college town, if you are looking for a good time, B-Town is where it’s at. You couldn’t ask for a more open bunch of people. You can make a new friend every day, anywhere you like….well, unless you are a Purdue fan, in which case we will not-so-kindly throw you out of our city ;]

  • BTown_Lady

    As someone who lives in Bloomington, I have to point out that 1) It’s a college town and there is bound to be an abundance of swearing and that 2) Despite being a college town, if you are looking for a good time, B-Town is where it’s at. You couldn’t ask for a more open bunch of people. You can make a new friend every day, anywhere you like….well, unless you are a Purdue fan, in which case we will not-so-kindly throw you out of our city ;]

  • Mbk121

    I grew up in El Paso and spent a great deal of time in Manchester UK after college, and found the people in both places to be helpful, hospitable, and polite. I think researchers bring out the worst in human nature.

  • The Burgh Born

    and if Yin’s had dun any research, Yin’s guys would know dat in Picsburgh, da people speak Picsburgese! All Yin’s godda do is go ta duhntun Picsburgh, see a Stiller game, have some good eats and an cold Irn City Beer and spend some time widda people of da Burgh, and yin’s would understand dat!!!

  • Jrod

    Who Gives A Flying F#@k? Get a Real Life (and Job for that matter)

  • Neybero

    Garbage In = Garbage Out

  • Lopez726

    you guys are insane you should try going to new mexio there rude there especially las cruces

  • http://www.dcfemella.com dcfemella

    DC should have been number 1. Love my city, but damn, there are some rude individuals

  • Anonymous

    Does anyone really believe that Foursquare users are representative of the communities they live in? I’m quite sure the sampling error in this study is too high to make it very meaningful, particularly for El Paso.

  • someonesaid

    You have only found the most rude people in the data collected on your servers. You do not state what where your data is collected or when it was collected. As a whole, your deduction is of no worth. I could fill a data base with any data I desired and then perform a search that would give me the results I wanted.

  • ThinkingItOver

    My guess is that the soccer goons are helping keep Manchester at the top of the list… knowing that Foursquare is more of a young adult app… and thinking my way through the other top ranked cities… seeing them as significant college towns… I wonder how many of the rude words are posted by outspoken fans of Rival sports teams…

  • Proudelpasoan

    learn how to spell before you talk shit, guey. maybe people will then take you seriously puto.

  • Ajnichols890

    Its funny that you define the politeness of your city with rudeness.

  • http://twitter.com/kozmoz4 Zeynep Öner

    You mean the rudest of the “English Speaking” world, right?

  • meleagrid

    don’t understand the % makeup. in general it seems as tho rudeness is not common. ex, if .018 seems to be 1.8%; is that high? You are an insult to humanity and the minds humans.

  • Jacoliame

    Ajnichols890 . You don’t do ironic humour do you ?.

  • http://twitter.com/javame Antonio Terreno

    Nice article, we have exactly the same architecture and we use the same languages.
    But we opted for in-house hosted hadoop master/slaves.

  • Hankfox

    Hey Raelin, let’s fix the Pittsburgh problem by contacting the media and have them ask the people to stop leaving tips.

  • Getting annoyed

    Not meaning to be rude or anything, but… This is going into my examples-of-bad-research file for the university social science methods class that I teach. “Ooh, I bet swearing would be a fun think to look at for measuring rudeness!” is exactly the kind of thing that shows how much people underestimate what’s required to do good–or even passable–social science research, and what happens as a result.

    Engineers and computer scientists (among others) are really good at doing the math for analyses they post online, but they can be really bad at doing the thinking. Or maybe they’re just lazy.

    Part of me wants to keep thinking this is all fun and games, but you’ve presented it seriously, it’s being picked up and reposted, and people are going to actually believe this crap. (That last bit added because, well, I am from Pittsburgh.)

  • Dunmanway8

    Man it’s a good thing I speek Pitsburgese.

  • Dude

    WHOOSH

  • http://www.facebook.com/smelleecat Lop Sided

    Ha! Comedy…..who decided curse words were rude anyway. I use them daily, equally with love and hate. Never in front of children or elderly, which is more than I can say for some people. Now thats manners. -Liz, San Diego

  • I_pp_n_bed

    Live here. Hate it.

  • http://www.facebook.com/people/Randi-Grahn-Moore/100000112896610 Randi Grahn Moore

    Rudeness simply based on the number of curse words used in blog posts seems to simplistic. Rudeness encompasses so many other things, most of them intangible such has whether or not a server or store clerk smiles at you, if people say please and thank you, if drivers allow others to merge without pinching them out. I’ll take foul language over flat-out rudeness any day!

  • Bob, PA

    Your method of determining rudeness is no doubt flawed. Having visited Melbourne, I found the people to be hospitable and kind. In additon, hotel management & employees were excellent. I never heard a curse word uttered. I recommend Melbourne to anyone visiting Australia.

  • Saul_newage

    El Paso is the bomb and booming. People here are great. Buy your next home in El Paso at http://www.homesearchelpaso.com

  • elpasoan

    LOL , tell em’ ey!! heres a website in spanish for your next home http://www.casaenelpaso.com

  • cao ni ma

    Post the list of curse words you drew from… From the sound of it, you mean “the rudest cities in the ENGLISH SPEAKING world”
    Don’t mislead people.

  • Sandkryan125

    As a 5th generation Californian and now first generation Wyomingite, I can totally undertand. There are a number of reasons I don’t live in CA any more. High taxes, poor work climate, and generalized laziness, I sympathize with the multple CA entries.

  • Barbara Martin

    I disagree with your statement about the prople of France. We were in Paris France in Septermber 2010 and we fourd the people to be extremely friendly and nice and polite as well as accomandating to what we asked, either for direcrtions and restaurants.

  • Disregardsuchsurveys

    Portland…rude, really. Grew up in Chicago, lived in San Jose and Portland. And why is using curse words alone without considering any other criteria enough to be globally tagged as rude. How shallow. How 2011.

  • http://paulpowered.com/ phxwebguy

    F#%&! Yeah Scottsdale!

  • Rickywarner49

    Stunning. I am from the east coast originally, Washungton D.C. to be precise. Hasn’t anybody ever been to Brooklyn ?

  • AN AWESOME BOCA BITCH!

    WELL, BASED ON YOUR HALF-ASSED SYSTEM (Lets say we want to find the city with the rudest citizens, judged by how often a tip left in that city contains a curse word. We could run this query:) all this means is that the “tips” received from these towns included curse words….DID YOU ASK THESE PEOPLE WHERE THEY WERE FROM, OR DID YOU JUST ASSUME THEY LIVE IN THE CITY THEY POSTED THEIR COMMENT ON? BOCA RATON, FLORIDA, for example is full of hard working, honest and friendly people, however< over the past 30 years, a lot of people from all over the world, (MOSTLY WEALTHY BUSINESS PEOPLE), have moved there and assumed it as their "home" when in fact they are just residents there, bringing in their screwed up RUDE manners and faiths, making the REAL Boca Raton citizens look bad – Now YES, if you mess with one of us, we will see that you become gator bait or shark chum without even a blink – WE TAKE CARE OF OUR OWN – I would like to know where you are from so I can make FALSE RUDE remarks about it all over the news and internet – but as we say in BOCA RATON, "PAYBACKS ARE A BEACH! Here's to you idiots who had the gall to even make such a remark without doing any intelligent type of research on these towns – can't wait till I see you standing outside the gates of heaven – like Boca Raton, we will not let you in!!! :) :) :)

  • Futanger

    I was born and raised in Las Cruces, and please don’t confuse cleanliness, class, and morals as rudeness. El Paso is dirty and full of people who think everything is owed to them! How many hit and runs happen there? In Las Cruces that’s unheard. Whether it be mexicans or El Pasoans involved in them, its taking place in that crappy city, and the accidents are just the tip of the iceberg of the epic failure and down fall of that hell hole. Heck even most Texans refuse to claim you guys as part of that state, and I don’t blame them.

  • Futanger

    Oh so what ur saying is there haven’t been any innocent casualties in the drug wars over in Jaurez? Hmm all those newspaper articles and reports must have been mistaken. So glad u cleared that up. Now we can all leave the dirty hell hole of rudeness, aka El Paso, and cross the border into the ever so safe, even dirtier and bigger hell hole of rudeness, aka Juarez! Sweet, I’m so happy u’ve been there enough to know that as long as we stay out of the drug business, we hav no worries. I honestly feel like I should trust ur claims right now!… NOT!!! Read a damn paper or watch the news! Ha, u must be a Hell Pasoan! Its the only explanation for ur oblivion!

  • Zeebirdman

    Just shows what a bunch of fucking Eggheads who couldn’t run a Hot-Dog stand come up with. When did swear words become equated with rudeness? What snarky yahoo with a white cane and sunglasses came up with that connection? Sure wouldn’t want to let any of these pieces of protoplasm anywhere near my Marketing Program. Be out of business in a month. Wonder what these schmucks are smoking?

  • Misskania

    It’s the DATA talking, people! Not some kind of crap the 4sq engineers fabricated for! Better watch out what you type in next time then…

  • http://www.couponcodes4u.com coupon codes

    I think there is a flaw on your system. I went over the tips left regarding El Paso and there was only one negative tip.

  • http://twitter.com/CheShA Cristian

    Your headline is not exactly a fair angle on the story, and I think it’s horrendously short sighted of you to define such a fine and friendly city, on a globally powerful blog such as this, as “rude”, based on such a simple and misrepresentative metric.

    You could have put any kind of spin on this, but instead, you chose to define a city that is renowned for its friendly and inclusive populace as “rude”, turning what could have been a fun article into an insult.

  • delraybtch

    it’s all about who you know in the city you’re in. some people are rude, some aren’t. that’s life.

  • KimJongIII

    FUck you Jacolamo

  • Jacoliame

    Kim. It’s Jacoliame. It’s not difficult. An idiot could spell it. (Maybe not).

  • Rrbdrck

    How do you qualify a word or term as being rude? I could say “this place is fucking awesome” and that’s not necessarily rude like “that waitress was a fucking bitch” – by using the word “fucking” are they both rude negative in your results?

  • http://alexzander-elise-music.com Andrew J Graves

    So true, love it. What’s a tosser? <—Lke what it seems to mean.

  • Majik

    Lighten up people (and get a dictionary)!

    “Rude” doesn’t necessarily mean unfriendly. The word “rude” has a lot of meanings, and a perfectly valid meaning is “rough in manners or behaviour”. Cursing certainly falls into this definition. As a measure of “rudeness”, that being “propensity to curse”, this is a perfectly valid and, I would say, fundamental measurement.

    People have no justification for getting upset about this. It’s not an insult. It’s a measurement of a fact (that fact being how likely people are to curse in a given location).

    Unless, of course, you have a problem the accusation that people in your area curse a lot. The trouble here is the evidence supports this. If you really don’t like this association then you either have to change your local culture, or move!

  • http://pulse.yahoo.com/_DBFRC327C54O7U25OAMXNRWWWE Anonymous

     Lived there Hated it!

  • Arun

    WOW !! All are worried on the results but not about technology they are sharing? come on guys!!  …Thanks for the post Four Square ..i don’t care abt the results.

  • sEEkEr

    Boca? Fuck’n awesome….

  • Alwayskathyann

    I got the humor. Nice. People are too nicey nice these days – need the cutting edge of irony.

  • Anonymous

    Very interesting. Both the data query implementation and the results. Will have to tell my London friend that UK is still #1.

    dc in tx

  • Ktmagnum

    OMG!!   I recently spent 3 months in West Palm Beach and worked in Boca Raton (Registered Nurse).  I have never run across a group of people who were so rude.  Rude drivers, employees of EVERY establishment I had contact with were rude and just downright nasty.  Customer service is the WORST (rude to non-existent).  The place is absolutely beautiful, but the people who live there are gross.  What is the deal?  …still trying to figure it out.    I have never been so happy as I was the day I came home to Virginia Beach, VA.    I am used to people who are kind and treat one another with respect.   This was definitely an eye opener.    

  • Anonymous

    How do you store these trillion records in a format that is possible for real-time query? Do you just push them from S3 to your MongoDB server?
    I am not sure how this can work with such a huge number of data.