Resources >‏ News >‏ News Details

News Details

QCRI launches RHEEM big data app

Publication Date:
10/07/2016
Category:
News
jorge.jpg

The Qatar Computing Research Institute (QCRI), a division of Hamad bin Khalifa University, has launched an application that can draw insights from big data across many software platforms.

The application, RHEEM, named after a native gazelle in Qatar, is the first general purpose system capable of what scientists call cross-platform data processing to be launched.

QCRI scientist Jorge-Arnulfo Quiané-Ruiz, who led the development of the software, said as the use and analysis of big data spread, organisations were using different specialised big data platforms to address specific needs.

“For example, social media and customer purchase analytics typically require separate software platforms,” Quiané-Ruiz said.

An airline could use RHEEM to mine data from a passenger database to target promotions to customers based on flight history data from information stored in a passenger list. RHEEM could then help the airline’s engineers to use this information to schedule extra flight capacity with data stored separately on multiple platforms. Qatar Airways has agreed to test the technology.

Hospitals could use the application to improve patient monitoring. For example, doctors might need to gather information about patients (whose information is typically stored in a database) who have received similar prescriptions, information usually stored in text files.

The oil industry could also use RHEEM to analyse structured and unstructured data to improve efficiency. During an exploration phase, for instance, data has to be acquired, integrated and analysed in order to predict if a reservoir will be profitable.

Quiané-Ruiz said RHEEM operated like a platform integrator or coordinator that used a set of rules to decide how to map a request from the application layer all the way down to the right platform.  It works in a layered fashion, with the application sitting on the top layer and the bottom layer connecting with a myriad of popular platforms.

“Rheem can decide, for example that for certain tasks PostgreSQL is the right option but for others, distributed platforms like Hadoop or Spark could be more efficient,” Quiané-Ruiz said.

“The key challenge was to come up with a small set of rules that are not too complicated but at the same time could manage the diversity of data analysis tasks.”

RHEEM allows users to easily specify these tasks with easy-to-use interfaces, provides developers with opportunities to optimise performance in different ways and can run on any data-processing platform, such as PostgreSQL, Spark or GraphChi.

The software has been presented to scientists at leading international conferences including SIGMOD, VLDB and EDBT.


Follow Us

  • YouTube
  • Twitter
  • Facebook
  • RSS Feed
  • Linkedin
  • github-web.png
Back to Top

In the Media

roadtracer.png

MIT/QCRI system uses machine learning to build road maps

22/04/2018

Map apps may have changed our world, but they still haven’t mapped all of it yet. Specifically, mapping roads can be difficult and tedious: even after taking aerial images, companies still have to ...

Read More

Economist story pic.JPG

Improving disaster response efforts through data

08/02/2018

Extreme weather events put the most vulnerable communities at high risk. How can data analytics strengthen early warning systems and and support relief efforts for communities in need? The size and ...

Read More

Yazan Wired story pic.jpg

Your sloppy bitcoin drug deals will haunt you for years

28/01/2018

Perhaps you bought some illegal narcotics on the Silk Road half a decade ago, back when that digital black market for every contraband imaginable was still online and bustling. You might already ...

Read More

Events

2018

Eman interns pic 2017.jpg

QCRI Summer Internship Program

Download ICS File 06/05/2018  - 05/07/2018 , Hamad Bin Khalifa Research Complex

Each year, Qatar Computing Research Institute organizes a summer internship program for undergraduate students studying computer science, computer engineering and other disciplines. The internship is unpaid, and QCRI does not provide any visa support.

Read More

Past Events

Regina

Public Talk by Prof. Regina Barzilay "Artificial Intelligence for Oncology: Learning to Cure Cancer from Images and Text"

Download ICS File 27/03/2018 ,

Artificial Intelligence for Oncology: Learning to Cure Cancer from Images and Text A talk by Professor Regina Barzilay, MIT CSAIL Winner of 2017 MacArthur ‘genius grant’ At Education City Student ...

Read More

Slide1.JPG

QCRI & MIT-CSAIL Annual Project Review 2018

Download ICS File 27/03/2018 ,

Executive Overview Sessions Open to public Date:    Tuesday, March 27, 2018 Time:    9:00AM – 3:00PM Venue:  HBKU Research Complex Multipurpose Room To view full agenda, please click here . To RSVP, ...

Read More

News

ahmed pic.JPG

QCRI to launch Center for Artificial Intelligence (Q-CAI)

14/05/2018

Initiative plans to ramp up development of artificial intelligence technologies to position Qatar as a global leader in AI.

Read More

humdata15.jpg

QCRI hosts humanitarian data skills workshop

09/05/2018

Joint event with UNOCHA's Centre for Humanitarian Data, the Qatar Red Crescent Society and Education Above All Foundation held to devise common practices for data use in humanitarian action.

Read More

Majd Interns1.jpg

QCRI welcomes 2018 summer interns

06/05/2018

Projects will include developing a TEDTalk visualization, deep maps, learning from time series sensor data, real-time detection of phishing domains and developing a voice ID speaker recognition system.

Read More