{"id":11310,"date":"2022-10-26T13:45:46","date_gmt":"2022-10-26T11:45:46","guid":{"rendered":"https:\/\/www.upm.es\/recursosidi\/offers-resources\/sin categor\u00eda\/cumulonimbo-bigdata-platform-analytics-in-a-wink\/"},"modified":"2022-10-26T13:45:48","modified_gmt":"2022-10-26T11:45:48","slug":"cumulonimbo-bigdata-platform-analytics-in-a-wink","status":"publish","type":"product","link":"https:\/\/www.upm.es\/recursosidi\/en\/offers-resources\/technological-solutions\/cumulonimbo-bigdata-platform-analytics-in-a-wink\/","title":{"rendered":"CUMULONIMBO BigData Platform. Analytics in a wink"},"content":{"rendered":"<h4><strong>Brief description of the technology solution and the added value it provides <\/strong><\/h4>\n<p class=\"MsoNormal\">An ultra-scalable transactional database with On Line Analytical Processing (OLAP) capabilities able to query TBs of data in seconds while processing million transactions per second and correlating millions of events per second. CumuloNimbo BigData platform is a scale-out solution for OLTP, OLAP and CEP where you store your data once therefore, avoiding costly ETLs and its associated headaches. It also provides transparent scalability for transactional processing on commodity hardware enabling to scale the database in public or private clouds avoiding sharding. The solution is built on top of NoSQL technology, Hadoop HDFS and HBase providing also full ACID transactions for HBase and enabling to combine SQL and NoSQL as needed. The integration with the Hadoop ecosystem enables to exploit existing open source products from this ecosystem such as R for predictive analysis and Mahout for large scale machine learning.&nbsp;<\/p>\n<h4><strong>Description of the technological base<\/strong><\/h4>\n<p><span style=\"font-size: small\"><img fetchpriority=\"high\" decoding=\"async\" style=\"float: left;margin-left: 5px;margin-right: 5px\" title=\"CumuloNimbo BigData \" src=\"http:\/\/www.upm.es\/observatorio\/vi\/gestor_general\/recuperar_archivo.jsp?id=480\" alt=\"big data, Hadoop, NoSQL, SQL\" width=\"263\" height=\"200\" \/><\/span><\/p>\n<p>It is the first solution able to scale transactions providing full ACID transactions with full SQL support and providing standard interfaces (JDBC, ODBC) in a fully transparent way to applications (your data management application will be scaled without touching a single comma) based on commodity hardware and amenable to be run in public and private clouds.<\/p>\n<p>The platform also incorporates a scale-out parallel query processing to provide OLAP support and perform analytical queries over TBs of data in seconds.<\/p>\n<p>Finally, the platform also integrates a scale-out parallel complex event processing engine able to correlate millions of events per second.<\/p>\n<p><span style=\"font-size: small\">&nbsp;<\/span><\/p>\n<p style=\"text-align: center\"><span style=\"font-size: small\"><em><strong>&nbsp;<\/strong><\/em><\/span><\/p>\n<p style=\"text-align: center\"><span style=\"font-size: small\"><em><strong>In a wink, we answer your queries over TBs of data, process millions of transactions updating your data, and correlate millions of events with your data<\/strong><\/em><\/span><\/p>\n<h4><strong>Market demands<\/strong><\/h4>\n<ul>\n<li><strong>Scalable Databases in Public &amp; Private Clouds:&nbsp; <\/strong>Current cloud databases do not scale. They way to overcome this gap is by means of sharding, splitting the database into fragments. However, the transactional ACID properties are lost extremely complicating the application requiring very costly changes.<\/li>\n<li><strong>Avoiding copying data through ETLs: <\/strong>Current database systems are specialized on different tasks. Transactional databases are used for the production database due to their ability to support updates in a consistent manner. Data warehouses are used for getting online responses to heavy analytical queries. However, this approach requires to architect, develop and plan a process to copy from the production database to the data warehouse, the so-called ETL process. It is estimated that ETLs are 75-80% of business analytics.<\/li>\n<li><strong>Operational Intelligence and New Applications: <\/strong>Many companies have the same recurrent question: how to monitor their business processes to react faster to opportunities and threats. Current IT infrastructure results in reaction times of days.<\/li>\n<\/ul>\n<h4><strong>Competitive advantages<\/strong><\/h4>\n<ul>\n<li>Scalable transactions for public &amp; private clouds providing full ACID transactions &amp; full SQL transparently to applications: Avoids sharding and 100% of its cost.<\/li>\n<li>OLTP+OLAP on a single database: Avoids the costs of ETLs that are estimated to be 75-80% of the overall costs of analytics. Enables real-time business intelligence.<\/li>\n<li>Correlate massive events with your data: Enabling operational intelligence with OLTP+CEP+OLAP<\/li>\n<li>Based on commodity hardware and scaling out: Avoids the costs of appliances, usable in clouds.<\/li>\n<li>Based on Hadoop ecosystem and interoperable with ecosystem tools such as R, Mahout, Flume, etc.<\/li>\n<\/ul>\n<p style=\"text-align: center\"><span style=\"font-size: small\"><em><strong>&nbsp;<\/strong><\/em><\/span><\/p>\n<p style=\"text-align: center\"><span style=\"font-size: small\"><em><strong>&ldquo;Scale your Database Without Limits Avoiding Sharding and its Associated High Cost&rdquo;<\/strong><\/em><\/span><\/p>\n<h4><strong>Previous references<\/strong><\/h4>\n<ul>\n<li>A large international bank is already evaluating the adoption of the platform.<\/li>\n<li>The co-founders have led 5 European projects and obtained and managed 6+ Million Euro in the last 5 years. They have been &nbsp;intensively researching scalable data management during the last 15 years.<\/li>\n<\/ul>\n<h4><strong>Intellectual property<\/strong><\/h4>\n<p>2 filed patents, protecting all the core innovations:<\/p>\n<ul>\n<li>USPTO 61\/356,353 (scalable transactions)<\/li>\n<li>USPTO 61\/561\/508 (parallel query processing)<\/li>\n<\/ul>\n<h4><strong>Development stage<\/strong><\/h4>\n<ul>\n<li><span style=\"font-size: small\">Concept<\/span><\/li>\n<li><span style=\"font-size: small\">R&amp;D<\/span><\/li>\n<li><span style=\"font-size: small\">Lab-Prototype<\/span><\/li>\n<li><span style=\"font-size: small\">Industrial Prototype<\/span><\/li>\n<li><span style=\"text-decoration: underline\"><strong><span style=\"font-size: small\">Production<\/span><\/strong><\/span><\/li>\n<\/ul>\n<h4>Contact<\/h4>\n<p><strong><span style=\"font-size: small\">Contacto CumuloNimbo BigData Platform<\/span><\/strong><\/p>\n<p><span style=\"font-size: small\">Ricardo Jim&eacute;nez-Peris, Marta Pati&ntilde;o-Mart&iacute;nez<\/span><\/p>\n<p><span style=\"font-size: small\">Distributed Systems Lab (LSD) &#8211; UPM<\/span><\/p>\n<p><span style=\"font-size: small\">e: {rjimenez, mpatino}@fi.upm.es<\/span><\/p>\n<p class=\"MsoNormal\"><strong><span style=\"font-size: small\">Contacto UPM<\/span><\/strong><\/p>\n<p class=\"MsoNormal\"><span style=\"font-size: small\">&Aacute;rea de Innovaci&oacute;n, Comercializaci&oacute;n y Creaci&oacute;n de Empresas<\/span><\/p>\n<p class=\"MsoNormal\"><span style=\"font-size: small\">Centro de Apoyo a la Innovaci&oacute;n Tecnol&oacute;gica&nbsp; &ndash; UPM <\/span><\/p>\n<p><span style=\"font-size: small\"> e: <span rel=\"86311a30a8313431a7313831a631193195311731bc312d3167314231aa312831af313331be313c31bb312c31a631213191312e31bb312b3184312f31a931\" class=\"cryptex \" style=\"\"><span class=\"CryptexImg ctxNRU9JXTxkeNV5RedLgX4X8hoRoRFBktvhz2uO3BCKdA\"><\/span><\/span><br \/><\/span><\/p>\n<div class=\"pdfprnt-buttons pdfprnt-buttons-product pdfprnt-bottom-left\"><a href=\"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/product\/11310?print=pdf\" class=\"pdfprnt-button pdfprnt-button-pdf\" target=\"_blank\"><span class=\"pdfprnt-button-title pdfprnt-button-pdf-title\">Descargar ficha<\/span><\/a><\/div>","protected":false},"excerpt":{"rendered":"<p>The Power of a Wink: while you wink we answer your queries over terabytes of data, process millions of transactions and correlate millions of events\u00a0<\/p>\n","protected":false},"featured_media":11309,"template":"","meta":{"_acf_changed":false},"product_cat":[2386],"product_tag":[8431],"comunidades-upm":[],"quien":[],"mapa":[{"term_id":37,"name":"Digital Technologies, Artificial Intelligence, Cybersecurity, 5G, Robotics","slug":"digital_technologies-ai-cybersecurity-5g-robotics","term_group":0,"term_taxonomy_id":37,"taxonomy":"mapa","description":"","parent":0,"count":83,"filter":"raw","term_order":"24"}],"disponibilidad":[{"term_id":205,"name":"Consultar disponibilidad","slug":"consultar","term_group":0,"term_taxonomy_id":205,"taxonomy":"disponibilidad","description":"","parent":0,"count":290,"filter":"raw","term_order":"0"}],"donde":[{"term_id":1884,"name":"Artificial Intelligence R&amp;I Centre (AI.nnovation Space)","slug":"en_artificial-intelligence-ri-centre-ai-nnovation-space","term_group":0,"term_taxonomy_id":1884,"taxonomy":"donde","description":"","parent":0,"count":41,"filter":"raw","term_order":"0"},{"term_id":664,"name":"Centro de I+D+i en Inteligencia Artificial (AI.nnovation Space)","slug":"centro-de-idi-en-inteligencia-artificial-ai-nnovation-space","term_group":0,"term_taxonomy_id":664,"taxonomy":"donde","description":"","parent":0,"count":44,"filter":"raw","term_order":"0"},{"term_id":1736,"name":"Distributed Systems Laboratory (DSL)","slug":"en_distributed-systems-laboratory-dsl","term_group":0,"term_taxonomy_id":1736,"taxonomy":"donde","description":"El LSD lleva trabajando durante m&aacute;s de 20 a&ntilde;os en bases de datos y gestores de datos ultra-escalables y altamente disponibles en el contexto de computaci&oacute;n en nube, <em>big data<\/em> y <em>data science<\/em>. \n Nuestros intereses de investigaci&oacute;n abarcan diferentes aspectos de la teor&iacute;a y la pr&aacute;ctica de los sistemas distribuidos con fuerte &eacute;nfasis en la escalabilidad, consistencia y la alta disponibilidad.\n&nbsp;\n<a href=\"http:\/\/leanxcale.com\/\">LeanXcale<\/a> es una spin-off del laboratorio que comercializa algunos de los resultados de esta investigaci&oacute;n, concretamente una base de datos ultra-escalable con soporte transaccional (ACID) y SQL completo. LeanXcale ha recibido el premio a la startup m&aacute;s innovadora, <em><a href=\"https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/2017-innovation-radar-prize-winners\">&ldquo;Best Young SME&rdquo;<\/a><\/em> por parte del <em>Innovation Radar <\/em>de la Comisi&oacute;n Europea<em>.<\/em>\n<em>&nbsp;<\/em>\nNuestras l&iacute;neas de investigaci&oacute;n son:\n&nbsp;\n\nBases de Datos y Gestores de Datos ultra-escalables.\n<em>Complex Event Processing.<\/em>\nComputaci&oacute;n en nube, plataformas como servicio.\n<em>Big Data<\/em>.\n","parent":0,"count":2,"filter":"raw","term_order":"0"},{"term_id":512,"name":"Laboratorio de sistemas distribuidos (LSD)","slug":"laboratorio-de-sistemas-distribuidos-lsd","term_group":0,"term_taxonomy_id":512,"taxonomy":"donde","description":"El LSD lleva trabajando durante m&aacute;s de 20 a&ntilde;os en bases de datos y gestores de datos ultra-escalables y altamente disponibles en el contexto de computaci&oacute;n en nube, <em>big data<\/em> y <em>data science<\/em>. \n Nuestros intereses de investigaci&oacute;n abarcan diferentes aspectos de la teor&iacute;a y la pr&aacute;ctica de los sistemas distribuidos con fuerte &eacute;nfasis en la escalabilidad, consistencia y la alta disponibilidad.\n&nbsp;\n<a href=\"http:\/\/leanxcale.com\/\">LeanXcale<\/a> es una spin-off del laboratorio que comercializa algunos de los resultados de esta investigaci&oacute;n, concretamente una base de datos ultra-escalable con soporte transaccional (ACID) y SQL completo. LeanXcale ha recibido el premio a la startup m&aacute;s innovadora, <em><a href=\"https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/2017-innovation-radar-prize-winners\">&ldquo;Best Young SME&rdquo;<\/a><\/em> por parte del <em>Innovation Radar <\/em>de la Comisi&oacute;n Europea<em>.<\/em>\n<em>&nbsp;<\/em>\nNuestras l&iacute;neas de investigaci&oacute;n son:\n&nbsp;\n\nBases de Datos y Gestores de Datos ultra-escalables.\n<em>Complex Event Processing.<\/em>\nComputaci&oacute;n en nube, plataformas como servicio.\n<em>Big Data<\/em>.\n","parent":0,"count":3,"filter":"raw","term_order":"0"}],"infraestructura":[],"ods":[{"term_id":2249,"name":"Industry, Innovation and Infrastructure","slug":"industry-innovation-and-infrastructure","term_group":0,"term_taxonomy_id":2249,"taxonomy":"ods","description":"","parent":0,"count":129,"filter":"raw","term_order":"0"}],"origen":[{"term_id":192,"name":"Soluciones tecnol\u00f3gicas","slug":"soluciones-tecnologicas","term_group":0,"term_taxonomy_id":192,"taxonomy":"origen","description":"","parent":0,"count":278,"filter":"raw","term_order":"0"}],"familia_tax":false,"quien_tax":false,"donde_tax":false,"year":"2020-01-01","contacto":"ETSI Inform\u00e1ticos - UPM, Campus de Montegancedo, 28660 Boadilla del Monte (Madrid)","telefono":"910672801","pagina_web":"http:\/\/www.fi.upm.es\/","email":"mpatino@fi.upm.es","id_ficha_portal":"87","video":"","adjuntos":false,"adjuntos_portal":"","inf":false,"departamento":"","acf":[],"lang":"en","translation":{"en":11310,"es":11308},"_links":{"self":[{"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/product\/11310"}],"collection":[{"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/product"}],"about":[{"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/types\/product"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/media\/11309"}],"wp:attachment":[{"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/media?parent=11310"}],"wp:term":[{"taxonomy":"product_cat","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/product_cat?post=11310"},{"taxonomy":"product_tag","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/product_tag?post=11310"},{"taxonomy":"comunidad_upm","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/comunidades-upm?post=11310"},{"taxonomy":"quien","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/quien?post=11310"},{"taxonomy":"mapa","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/mapa?post=11310"},{"taxonomy":"disponibilidad","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/disponibilidad?post=11310"},{"taxonomy":"donde","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/donde?post=11310"},{"taxonomy":"infraestructura","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/infraestructura?post=11310"},{"taxonomy":"ods","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/ods?post=11310"},{"taxonomy":"origen","embeddable":true,"href":"https:\/\/www.upm.es\/recursosidi\/wp-json\/wp\/v2\/origen?post=11310"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}