Global Economic Pulse: real-time Web search

Showing posts with label real-time Web search. Show all posts

Tuesday, August 18, 2009

The Future of Search: Social Relevancy Rank

FriendFeed has recently launched a search feature, and so Facebook search must be coming soon.

Real-time Web search (of streams of activities) is a hot topic right now. Everyone, including Google and Microsoft, recognizes the value of using trusted contacts as filters. What was once called social search is now called real-time search, but this time it will really happen. First, it will be applied to streams and then to the Web in general.

What we are about to get is a Social Relevancy Rank. Whenever you search streams of activity, the results will be ordered not chronologically but by how relevant each is to you based on your social graph. That is, people who matter more to you will bubble up. How does this work? Well, there will be a formula, just as there is a formula for Page Rank.

Solution 101: Rank by Friends and People You Follow

Here is an idea so obvious that it is surprising Twitter has not implemented it already: front-load search results with people you follow. When you search for, say, "Wilco" on Twitter today, the results are in the chronological order. That is not really relevant because you do not know who most of these people are. But if instead you could see people you follow, the search results would be much more useful.

This is not possible on Twitter today, but it already works great on FriendFeed. There, results are filtered or ranked based your social graph. This is not difficult for FriendFeed to do because, on the one hand, it knows who you care about and, on the other, it applies its advanced feed search technology to your social graph:

This sounds awesome, but there is a problem. "Wilco" works well as a query because the band has just released a new album, but many other queries would return no results. Simply put, your friends on Facebook and people you follow on Twitter can't possibly have an opinion on every topic you may be interested in. This is a problem of sparse data: trusted opinions are scarce.

Small Worlds and Taste Neighbors

To solve the problem of sparse data, we need more data... obviously. One possible solution is to incorporate other sources that you trust (i.e. broaden your social graph). As a next step, search results could rank people you may not be directly following but who are being followed by people you follow. Or in Facebook-speak, friends of friends. You could argue that you are not familiar with their opinions and so cannot yet trust them, but given the small world phenomenon, their contributions are often just as valuable.

Another step could be to include people with similar tastes, so-called taste neighbors. This approach is common among vertical social networks such as Last.fm, Flixster, and Goodreads. These networks have ideas about which people, other than your friends, are like you. However, this is a costly calculation and takes time. In order for Twitter to do something like this, it would have to compare people based on links or perform semantic analyses of tweets over time. Yet even though this is a difficult problem, it will be solved in time.

The Influencers and the Crowd

Aside from using the "second degree" of your social graph or taste neighbors, a Social Relevancy Rank could front-load influencers. In the absence of any other metric, someone who is followed by hundreds of thousands of users is likely more relevant to you than someone you don't know at all. Using number of followers as a weight might be a good way to order the rest of the activity stream.

In general, combing through countless tweets from strangers is not terribly useful anyway. Just as people have stopped looking at anything beyond the first page of results on Google, sifting through pages of tweets in chronological order gets tedious quickly. What needs to be incorporated into the Social Relevancy Rank is the aggregate sentiment of the crowd: a score that tells you yay or nay and gives you an opportunity to drill into more results if you choose.

The Quest for the Perfect Filter

There is no such thing as a perfect formula. Even Page Rank isn't perfect. Yet we all use it and find it useful. Much as Page Rank has been adapted and tuned to search the web, Social Relevancy Rank will evolve over time to help us make sense of endless streams of activity. This ranking will have a profound impact on how we tap into our friends' opinions.

It will change the face of general Web searches in time, too. Today, results are automatically ranked by relevancy and freshness. Once Social Relevancy Rank is factored in, search results will be re-ordered based on social relevancy.

http://globalblognetwork.blogspot.com/2009/07/technorati-to-launch-twittorati.html

http://globalblognetwork.blogspot.com/2009/05/google-unveils-new-search-features.html

http://globalblognetwork.blogspot.com/2009/05/twitter-search-to-index-pages-and.html

http://globalblognetwork.blogspot.com/2009/05/yahoo-upgrades-search-engine.html

http://globalblognetwork.blogspot.com/2009/05/search-sucks-and-microsoft-is-almost.html

http://globalblognetwork.blogspot.com/2009/05/searching-for-meaning-of-bing.html

http://globalblognetwork.blogspot.com/2009/05/microsoft-must-buy-twitter-msft.html

http://globalblognetwork.blogspot.com/2009/05/ballmer-on-bing-economy-and-more.html

http://globalblognetwork.blogspot.com/2009/07/china-google-and-pornography.html

http://globalblognetwork.blogspot.com/2009/05/google-they-might-be-little-evil.html

http://globalblognetwork.blogspot.com/2009/05/wolfram-alpha-has-google-attention.html

http://globalblognetwork.blogspot.com/2009/07/26-people-who-mislead-you-on-twitter.html

http://globalblognetwork.blogspot.com/2009/07/ballmer-all-traditional-content-will-be.html

http://globalblognetwork.blogspot.com/2009/07/rate-of-tweets-per-second-doubles.html

http://globalblognetwork.blogspot.com/2009/07/google-unveils-sms-service-for-africa.html

http://globalblognetwork.blogspot.com/2009/07/yahoo-ceo-stop-comparing-us-to-google.html

http://globalblognetwork.blogspot.com/2009/06/future-of-facebook-usernames.html

http://globalblognetwork.blogspot.com/2009/06/googles-schmidt-rips-microsofts-bing.html

http://globalblognetwork.blogspot.com/2009/06/history-and-future-of-computer-memory.html

http://globalblognetwork.blogspot.com/2009/07/kosmix-tries-to-avoid-google-search.html

http://globalblognetwork.blogspot.com/2009/07/dispute-finder-intel-program-finds.html

Source:

http://www.readwriteweb.com/archives/future_of_search_social_relevancy_rank.php

Tags:

FriendFeed search feature, Facebook search, real-time Web search, Google, Twitter, Twitter search, PageRank, Microsoft, trusted contacts as filters, social search, Global IT News, Social Relevancy Rank, metrics,

Posted via email from Global Business News

Tuesday, August 11, 2009

Five More Search Tools You Should Know

Have you ever needed to see the search results for another city — maybe because you want to see what PPC ads are shown somewhere else?

Have you ever needed to see search results from a different country, or in a different language? Maybe you’re into real time search, and you’d love a place to find the latest photos and videos being shared on Twitter. Or perhaps you’re planning a vacation abroad, but you’re not sure when is the best time to visit Europe.

It’s time again for another roundup of the latest and greatest search tools and search engines, and in this article, I’ll share five such sites that will answer the above questions (and more). This is the fourth in my occasional series profiling under-the-radar search tools. Links to the previous three are at the end of this article.

SearchMuffin

Look, I don’t name ‘em, I just use ‘em and write about ‘em if they’re cool. And this one is SearchMuffin has a simple premise: Type in a keyword and choose a city from the dropdown menu, and it’ll show you the Google search results that match. Think of it as a sort of geo-targeted competitive research/PPC research tool. It’s about the easiest way I know of to see the PPC ads that appear in other cities.

And best of all, it’s not just limited to major U.S. cities; at the moment, there are 262 choices in the dropdown menu, including such non-metropolises as Roseville, California, and Arvada, Colorado. (No disrespect intended to Rosevillites and Arvadians.)

Glearch

Let’s expand our horizons beyond 262 U.S. cities. What if you needed to quickly see some search results from other countries and/or other languages? Glearch (again, I don’t name ‘em) is an international meta search engine that lets you search by country, by language, and/or by search engine. You can take those three options and customize each to build just the query you want.

Roooby

We’ve written a fair amount about real time search in the past few months, but we haven’t focused too much on the visual element — people posting photos and videos of what they’re doing now. Roooby is one of several real time search engines that capture media, but one of the few that surface both photos and videos. (Although, to be frank, Roooby could do a better job of finding videos by scanning sites such as Qik.com, TwitVid.io, and others that host live video.)

Roooby isn’t the only player in this space. TwitCaps, TwitPicGrid, Pingwire, and Twicsy offer similar real time image search engines.

Spezify

Speaking of media and images, here’s the most visual search tool I’ve ever seen: Spezify. The best way I can describe it is a sort of visual meta search engine. It pulls in results from Yahoo, Bing, Twitter, Flickr, YouTube, and even eBay and Amazon to create a fairly stunning search results page.

This is serious eye candy. There’s a settings page where you can choose the sources and types of content (images, text, video) you want included. But to be frank, the focus on visuals means the search results have no context whatsoever. You can move vertically and horizontally through the results, but you have no idea why you’re seeing what you’re seeing. It’s innovative to be sure, but for this searcher, it’s too lacking in functionality.

Joobili

Finally, here’s one for our readers in Europe, or for our readers traveling to Europe. It’s called Joobili, and it’s a travel/event search engine with a twist: Rather than telling the search engine what you want to do or where you want to go, you tell it when. There’s a cool date-based slider on the home page to get you started, and once you’re in the results, Joobili lets you see results based on categories (Arts, Sport, Nature, etc.), by country, or by keyword.

If you create an account, Joobili will let you save events to a wish list or a “went” list. You can also rank events to help other users make decisions on what to do and where to go. It’s a clever approach, but as I hinted above, it only covers Europe.