CINXE.COM
UniQreate: Data Management Platform Deployment on Oracle Cloud Infrastructure
<!DOCTYPE html SYSTEM "about:legacy-compat"> <html xml:lang="en-us" lang="en-us" class="solution inspired"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="DC.Type" content="concept"> <meta name="DC.Title" content="UniQreate: Data Management Platform Deployment on Oracle Cloud Infrastructure"> <meta name="abstract" content="UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions."> <meta name="description" content="UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions."> <meta name="copyright" content="(C) Copyright 2021" type="primary"> <meta name="DC.Rights.Owner" content="(C) Copyright 2021" type="primary"> <meta name="copyright" content="(C) Copyright 2021" type="secondary"> <meta name="DC.Rights.Owner" content="(C) Copyright 2021" type="secondary"> <meta name="DC.Date.Created" content="November 2021"> <meta name="DC.Format" content="XHTML"> <meta name="DC.Identifier" content="GUID-3FA7B553-77AC-4C82-838C-35C013C163A8"> <meta name="DC.Language" content="en-US"> <meta name="viewport" content="width=device-width, initial-scale=1"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="abstract" content="UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions."> <meta name="description" content="UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions."> <title>UniQreate: Data Management Platform Deployment on Oracle Cloud Infrastructure</title> <meta property="og:site_name" content="Oracle Help Center"> <meta property="og:title" content="UniQreate: Data management platform deployment on Oracle Cloud Infrastructure"> <meta property="og:description" content="UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions."> <link rel="stylesheet" href="/sp_common/book-template/ohc-book-template/css/book.css"> <link rel="shortcut icon" href="/sp_common/book-template/ohc-common/img/favicon.ico"> <meta name="application-name" content="UniQreate: Data management platform deployment on Oracle Cloud Infrastructure"> <meta name="generator" content="DITA Open Toolkit version 1.8.5 (Mode = solution)"> <meta name="plugin" content="SP_docbuilder HTML plugin release 18.2.2"> <meta name="robots" content="all"> <meta name="keywords" content="Security,IaaS,Ansible,Machine Learning"> <link rel="schema.dcterms" href="http://purl.org/dc/terms/"> <meta name="dcterms.created" content="2021-11-18T14:16:14-08:00"> <meta name="dcterms.title" content="UniQreate: Data management platform deployment on Oracle Cloud Infrastructure"> <meta name="dcterms.dateCopyrighted" content="2021"> <meta name="dcterms.category" content="solutions"> <meta name="dcterms.identifier" content="F43680-03"> <meta name="dcterms.product" content="en/solutions;en/cloud/oracle-cloud-infrastructure/oci"> <meta name="dcterms.release" content="Test Release"> <script> document.write('<style type="text/css">'); document.write('body > .noscript, body > .noscript ~ * { visibility: hidden; }'); document.write('</style>'); </script> <script data-main="/sp_common/book-template/ohc-book-template/js/book-config" src="/sp_common/book-template/requirejs/require.js"></script> <script> if (window.require === undefined) { document.write('<script data-main="sp_common/book-template/ohc-book-template/js/book-config" src="sp_common/book-template/requirejs/require.js"><\/script>'); document.write('<link href="sp_common/book-template/ohc-book-template/css/book.css" rel="stylesheet"/>'); } </script> <script type="application/json" id="ssot-metadata">{"primary":{"category":{"short_name":"solutions","element_name":"Solutions","display_in_url":true},"suite":{"short_name":"built-deployed","element_name":"Built and Deployed","display_in_url":false},"product_group":{"short_name":"not-applicable","element_name":"Not Applicable","display_in_url":false}}}</script> <meta name="dcterms.isVersionOf" content="UNIQREATE-ON-OCI"> <script type="application/ld+json"> {"@context":"https://schema.org","@type":"WebPage","name":"UniQreate: Data Management Platform Deployment on Oracle Cloud Infrastructure","description":"UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions.","datePublished":"2021-09-22 16:01:12 PDT","dateModified":"2021-11-18 14:19:36 PST"} </script> <script>window.ohcglobal || document.write('<script src="/en/dcommon/js/global.js">\x3C/script>')</script></head> <body> <div class="noscript alert alert-danger text-center" role="alert"> <a href="index.html" class="pull-left"><span class="glyphicon glyphicon-chevron-left" aria-hidden="true"></span>Previous</a> <a href="#" class="pull-right">Next<span class="glyphicon glyphicon-chevron-right" aria-hidden="true"></span></a> <span class="fa fa-exclamation-triangle" aria-hidden="true"></span> JavaScript must be enabled to correctly display this content </div> <article> <header> <ol class="breadcrumb" vocab="http://schema.org/" typeof="BreadcrumbList"> <li property="itemListElement" typeof="ListItem"><a href="index.html" property="item" typeof="WebPage"><span property="name">UniQreate: Data management platform deployment on Oracle Cloud Infrastructure</span></a></li> <li class="active" property="itemListElement" typeof="ListItem">UniQreate: Data Management Platform Deployment on Oracle Cloud Infrastructure</li> </ol> <a id="GUID-3FA7B553-77AC-4C82-838C-35C013C163A8" name="GUID-3FA7B553-77AC-4C82-838C-35C013C163A8"></a> <h2 id="TQTEC-GUID-3FA7B553-77AC-4C82-838C-35C013C163A8" class="sect2">UniQreate: Data Management Platform Deployment on <span>Oracle Cloud Infrastructure</span></h2> </header> <div class="ind"> <div> <p>UniQreate is a data extraction automation company that helps businesses maximize the value of unorganized data by using the most efficient workflows and the least intrusive interactions.</p> <p>Many organizations have data spread across millions of documents that vary in structure, context, layout, and formats. Extracting relevant data from this unorganized data using manual resources or other tools takes lots of time and has limited scalability. UniQreate solves this problem by using artificial intelligence (AI), intelligent workflows, and web interfaces to improve their deep learning models. With this approach, as organization's data has better context and representation and can be used readily without dependence on manual processing or custom-built tools.</p> <p>UniQreate was looking to build their data management platform and chose <span>Oracle Cloud at Customer</span> (OCI) for the following reasons: </p> <ul style="list-style-type: disc;" id="GUID-3FA7B553-77AC-4C82-838C-35C013C163A8__UL_SKV_1CK_XPB"> <li>Agility when scaling compute and storage bandwidth </li> <li>Off-the-shelf higher compute power at a competitive cost</li> <li>Scalable file storage and managed MySQL services</li> <li>Object storage addresses all project storage needs</li> <li>Compartment feature provides a clean way to segregate and manage separate environments</li> </ul> <p>UniQreate has been part of <span>Oracle Cloud at Customer</span> startup program since 2020 and has been running 16 OCPU instances and 3 GPU instances for multiple client environments. This setup allows them to run 200 extraction cycles per day with model training running every 24 hours. </p> <p>With the features, functionality, and competitive cost provided by <span>Oracle Cloud at Customer</span>, UniQreate has been able to achieve 20% monthly savings on overall cost. </p> </div> <div class="sect2"><a id="GUID-2A323F70-829F-4670-99A8-DA1CF2E60CB1" name="GUID-2A323F70-829F-4670-99A8-DA1CF2E60CB1"></a><h3 id="TQTEC-GUID-2A323F70-829F-4670-99A8-DA1CF2E60CB1" class="sect3">Customer Story</h3> <div> <p>Learn more about UniQreate's journey to <span>Oracle Cloud</span>: <div class="video-box"> <div id="30371" class="video-container"></div> </div> </p> </div> </div> <div class="sect2"><a id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB" name="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB"></a><h3 id="TQTEC-GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB" class="sect3">Architecture</h3> <div> <p>This architecture shows UniQreate's multi-region disaster recovery architecture on <span>Oracle Cloud Infrastructure</span>. </p> <div class="p">UniQreate used the following in a layered approach for the deployment: <ul style="list-style-type: disc;" id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__UL_AZN_YGK_XPB"> <li>Web server: Provides extraction user interface and administrative capabilities</li> <li>Code manager: Determines the shapes of virtual machines (VMs) that need to be launched for the prediction engine</li> <li>Prediction engine: Runs artificial intelligence (AI) and machine learning (ML) modules</li> <li>Monitoring servers: Monitor the health and performance of the entire solution.</li> <li>File system: Provides scalable, low-latency storage for model and document metadata, independent from web servers and database servers</li> <li>Database server: Provides persistent storage for web servers</li> </ul> </div> <p>Automation is achieved using Ansible scripts to dynamically launch the prediction engine with the preferred shape. This scalable prediction engine helps address processing of large document based on the client's need.</p> <p>The virtual cloud network (VCN) where virtual machines (VM) are hosted is segmented into two subnets: a public subnet for the bastion host (for SSH connectivity), and a private subnet for VMs such as the code manager, prediction engine, file storage, and MySQL database servers. The public subnet also hosts a Jenkins server for continuous integration and deployment (CI/CD) requirements.</p> <p>Resources are deployed in multiple fault domains for high availability.</p> <p>Object Storage is used as backup for the entire environment, including images of each VM. A public load balancer distributes the traffic load across VMs. The environment uses two layers of security: one for network security implemented using network security lists and another that's application-specific, implemented using a network security group (NSG) for each network segment. Separate availability domains and separate fault domains within each availability domain are used for deployment, which provides high availability and greater fault tolerance within the region. The entire environment is also hosted in another region for disaster recovery. User access is managed using Identity and Access Management (IAM) policies.</p> <p>The entire set-up was deployed on <span>Oracle Cloud Infrastructure</span> in four days, providing maximum availability and uptime. For their future deployments, UniQreate is using <span>Oracle Cloud Infrastructure</span>'s GPU offering to improve and refine their deep learning models that customers can use to process their documents at $5–10M per year per client and generate much better context and representation of the text. </p> <p>The following diagram illustrates this reference architecture.</p><br><div class="imageleft"><img class="imageleft" id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__IMAGE_Q3D_MGK_XPB" height="1225" width="1441" src="img/uniqreate-oci.png" alt="Description of uniqreate-oci.png follows" title="Description of uniqreate-oci.png follows" longdesc="img_text/uniqreate-oci.html"><br><a href="img_text/uniqreate-oci.html">Description of the illustration uniqreate-oci.png</a></div><br><p><a href="img/uniqreate-oci.zip" class="de-download">uniqreate-oci.zip</a></p> <p>The architecture has the following components:</p> <ul style="list-style-type: disc;" id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__UL_QDH_4LM_CKB"> <li><span class="bold">Region</span><p>An <span>Oracle Cloud Infrastructure</span> region is a localized geographic area that contains one or more data centers, called availability domains. Regions are independent of other regions, and vast distances can separate them (across countries or even continents). </p> <p>All the resources in this architecture are deployed in a single region.</p> </li> <li><span class="bold">Availability domains</span><p>Availability domains are standalone, independent data centers within a region. The physical resources in each availability domain are isolated from the resources in the other availability domains, which provides fault tolerance. Availability domains don鈥檛 share infrastructure such as power or cooling, or the internal availability domain network. So, a failure at one availability domain is unlikely to affect the other availability domains in the region.</p> <p>All the resources in this architecture are deployed in a single availability domain.</p> </li> <li><span class="bold">Fault domain</span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e53">A fault domain is a grouping of hardware and infrastructure within an availability domain. Each availability domain has three fault domains with independent power and hardware. When you distribute resources across multiple fault domains, your applications can tolerate physical server failure, system maintenance, and power failures inside a fault domain.</p> </li> <li><span class="bold">Compartment</span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e59">Compartments are cross-region logical partitions within an <span>Oracle Cloud Infrastructure</span> tenancy. Use compartments to organize your resources in <span>Oracle Cloud</span>, control access to the resources, and set usage quotas. To control access to the resources in a given compartment, you define policies that specify who can access the resources and what actions they can perform. </p> </li> <li><span class="bold">Virtual cloud network (VCN) and subnets</span><p>A VCN is a customizable, software-defined network that you set up in an <span>Oracle Cloud Infrastructure</span> region. Like traditional data center networks, VCNs give you complete control over your network environment. A VCN can have multiple non-overlapping CIDR blocks that you can change after you create the VCN. You can segment a VCN into subnets, which can be scoped to a region or to an availability domain. Each subnet consists of a contiguous range of addresses that don't overlap with the other subnets in the VCN. You can change the size of a subnet after creation. A subnet can be public or private. </p> </li> <li><span class="bold">Security lists</span><p>For each subnet, you can create security rules that specify the source, destination, and type of traffic that must be allowed in and out of the subnet.</p> </li> <li><span class="bold">Remote peering</span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e230">Remote peering allows the VCNs' resources to communicate using private IP addresses without routing the traffic over the internet or through your on-premises network. Remote peering eliminates the need for an internet gateway and public IP addresses for the instances that need to communicate with another VCN in a different region.</p> </li> <li><span class="bold">Bastion host</span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e147">The bastion host is a compute instance that serves as a secure, controlled entry point to the topology from outside the cloud. The bastion host is provisioned typically in a demilitarized zone (DMZ). It enables you to protect sensitive resources by placing them in private networks that can't be accessed directly from outside the cloud. The topology has a single, known entry point that you can monitor and audit regularly. So, you can avoid exposing the more sensitive components of the topology without compromising access to them.</p> </li> <li><span class="bold">Load balancer</span><p>The <span>Oracle Cloud Infrastructure Load Balancing</span> service provides automated traffic distribution from a single entry point to multiple servers in the back end. </p> <p>This architecture includes a public load balancer.</p> </li> <li><span class="bold">Object storage</span><p> Object storage provides quick access to large amounts of structured and unstructured data of any content type, including database backups, analytic data, and rich content such as images and videos. You can safely and securely store and then retrieve data directly from the internet or from within the cloud platform. You can seamlessly scale storage without experiencing any degradation in performance or service reliability. Use standard storage for "hot" storage that you need to access quickly, immediately, and frequently. Use archive storage for "cold" storage that you retain for long periods of time and seldom or rarely access.</p> </li> <li><span class="bold">File storage</span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e185">The <span>Oracle Cloud Infrastructure File Storage</span> service provides a durable, scalable, secure, enterprise-grade network file system. You can connect to a File Storage service file system from any bare metal, virtual machine, or container instance in a VCN. You can also access a file system from outside the VCN by using <span>Oracle Cloud Infrastructure FastConnect</span> and IPSec VPN. </p> </li> <li><span class="bold"><span>Oracle MySQL Database Service</span></span><p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e540"><span>Oracle MySQL Database Service</span> is a fully managed <span>Oracle Cloud Infrastructure</span> (OCI) database service that lets developers quickly develop and deploy secure, cloud native applications. Optimized for and exclusively available in OCI, <span>Oracle MySQL Database Service</span> is 100% built, managed, and supported by the OCI and MySQL engineering teams. </p> <p id="GUID-DC0765BF-F23D-4BED-8E8C-3764A81E92EB__d5e548"><span>Oracle MySQL Database Service</span> has an integrated, high-performance analytics engine (HeatWave) to run sophisticated real-time analytics directly against an operational MySQL database. </p> </li> </ul> </div> </div> <div class="sect2"><a id="GUID-14B1CB42-E204-45F1-9E0F-EEBD66E39609" name="GUID-14B1CB42-E204-45F1-9E0F-EEBD66E39609"></a><h3 id="TQTEC-GUID-14B1CB42-E204-45F1-9E0F-EEBD66E39609" class="sect3">Get Featured in Built and Deployed</h3> <div> <p>Want to show off what you built on <span>Oracle Cloud Infrastructure</span>? Care to share your lessons learned, best practices, and reference architectures with our global community of cloud architects? Let us help you get started. </p> <ol id="GUID-14B1CB42-E204-45F1-9E0F-EEBD66E39609__OL_MD1_PPP_KRB"> <li><span class="bold"><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/solutions/uniqreate-on-oci&id=built-and-deployed-template" target="_blank">Download the template (PPTX)</a></span><p>Illustrate your own reference architecture by dragging and dropping the icons into the sample wireframe.</p> </li> <li><span class="bold"><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/solutions/uniqreate-on-oci&id=built-and-deployed-tutorial" target="_blank">Watch the architecture tutorial</a></span><p>Get step by step instructions on how to create a reference architecture.</p> </li> <li><span class="bold"><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/solutions/uniqreate-on-oci&id=built-and-deployed-email" target="_blank">Submit your diagram</a></span><p>Send us an email with your diagram. Our cloud architects will review your diagram and contact you to discuss your architecture.</p> </li> </ol> </div> </div> <div class="sect2"><a id="GUID-8144A668-7D8B-4971-86FE-B6863CFF0049" name="GUID-8144A668-7D8B-4971-86FE-B6863CFF0049"></a><h3 id="TQTEC-GUID-8144A668-7D8B-4971-86FE-B6863CFF0049" class="sect3">Explore More</h3> <div> <p>Learn more about the features of this architecture.</p> <p><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/solutions/uniqreate-on-oci&id=GVVGQ" target="_blank"><span><cite>Best practices framework for Oracle Cloud Infrastructure</cite></span></a></p> </div> </div> </div> </article> <div id="disclaimers" class="legal"> <div><a href="#copyright-information" role="button" data-toggle="collapse" aria-expanded="false" class="collapsed" aria-controls="copyright-information" id="copyright-information-btn">Title and Copyright Information</a></div> <div class="collapse" id="copyright-information" aria-expanded="false"> <p class="legal">UniQreate: Data management platform deployment on Oracle Cloud Infrastructure</p> <p class="legal">F43680-03</p> <p class="date legal">November 2021</p> <p class="legal legal"><a href="/pls/topic/lookup?ctx=en/legal&id=cpyr" target="_blank">Copyright © </a>2021, Oracle and/or its affiliates. </p> </div> <div><a href="#oracle-accessibility" role="button" data-toggle="collapse" aria-expanded="false" class="collapsed" aria-controls="oracle-accessibility" id="oracle-accessibility-btn">Documentation Accessibility</a></div> <div class="collapse" id="oracle-accessibility" aria-expanded="false"> <div> <p class="legal">For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at <a href="https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=docacc" target="_blank"><code class="codeph">https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=docacc</code></a>. </p> <div class="section" id="GUID-0D7ACBE9-7047-4DBE-97AA-703FD2FFBE5A__GUID-D88DC1A6-B2C8-4B61-85D2-23B0215F1664"> <p class="subhead1 legal" id="GUID-0D7ACBE9-7047-4DBE-97AA-703FD2FFBE5A__GUID-C09CA7BE-D07E-4AA0-B42A-8D7427CA200B">Access to Oracle Support</p> <p class="legal">Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit <a href="https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=info" target="_blank"><code class="codeph">https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=info</code></a> or visit <a href="https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=trs" target="_blank"><code class="codeph">https://docs.oracle.com/pls/topic/lookup?ctx=acc&id=trs</code></a> if you are hearing impaired. </p> </div> <!-- class="section" --> </div> </div> </div> </body> </html>