CINXE.COM

<!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <title>FAQ / Common Problems | Socrata</title> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta name="description" content=""> <meta name="author" content="">  <link href="//netdna.bootstrapcdn.com/bootstrap/3.3.6/css/bootstrap.min.css" rel="stylesheet">  <link href="//netdna.bootstrapcdn.com/font-awesome/4.5.0/css/font-awesome.css" rel="stylesheet"/>  <link href="//cdn.rawgit.com/noelboss/featherlight/1.3.4/release/featherlight.min.css" rel="stylesheet"/>  <link href="//fonts.googleapis.com/css?family=Ubuntu:bold" rel="stylesheet" type="text/css"/> <link href="//fonts.googleapis.com/css?family=Nobile" rel="stylesheet" type="text/css"/> <link href="//cdnjs.cloudflare.com/ajax/libs/highlight.js/9.1.0/styles/default.min.css" rel="stylesheet"/>   <link href="/datasync/common/css/common.css" rel="stylesheet"/> <link href="/datasync/common/css/murphy.css" rel="stylesheet"/> <link href="/datasync/css/local.css" rel="stylesheet"/>    <script src="/datasync/common/js/require.js"></script> <script> // Load common code and custom includes requirejs(['/datasync/common/js/common.js'], function(common) { var rel_require = function(script) { if(script.match(/^\/[^\/]/)) { script = '/datasync' + script; } requirejs([script]); }; // Site scripts // Page scripts }); </script>  <link rel="apple-touch-icon-precomposed" sizes="144x144" href="/datasync/common/ico/apple-touch-icon-144-precomposed.png"/> <link rel="apple-touch-icon-precomposed" sizes="114x114" href="/datasync/common/ico/apple-touch-icon-114-precomposed.png"/> <link rel="apple-touch-icon-precomposed" sizes="72x72" href="/datasync/common/ico/apple-touch-icon-72-precomposed.png"/> <link rel="shortcut icon" href="/datasync/common/ico/favicon.png"/>  <link type="application/atom+xml" rel="alternate" href="https://dev.socrata.com/feed.xml" title="Socrata Developer Blog"> </head> <body class="dev homepage faq-common-problems">    <div class="navbar navbar-inverse navbar-fixed-top dev" role="navigation">  <div class="navbar-header">  <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#nav-collapse"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </button> <a class="navbar-brand dev" href="/datasync/"><i class="fa fa-refresh"></i> Socrata DataSync</a> </div> <div class="collapse navbar-collapse" id="nav-collapse">  <form class="navbar-form navbar-right visible-lg" action="/datasync/search.html" method="GET" role="search"> <div class="form-group"> <input name="q" class="form-control search" type="text" placeholder="Search"> </div> </form>  <ul class="nav navbar-nav"> <li id="socrata-status" style="display: none"> <button type="button" class="btn" data-toggle="popover" data-placement="bottom" data-html="true"></button> </li> <li class="dropdown "> <ul class="dropdown-menu"> <li><a href="/datasync/">Getting Started</a></li> <li class="nav-header dropdown-header">General Guides</li> <li><a href="/datasync/guides/quick-start.html">Quick Start (GUI)</a></li> <li><a href="/datasync/guides/setup-standard-job.html">Setup a Standard Job (GUI)</a></li> <li><a href="/datasync/guides/setup-standard-job-headless.html">Setup a Standard Job (Headlessly)</a></li> <li><a href="/datasync/guides/setup-port-job.html">Setup a Port Job (GUI)</a></li> <li><a href="/datasync/guides/setup-port-job-headless.html">Setup a Port Job (Headlessly)</a></li> <li><a href="/datasync/guides/setup-gis-job.html">Setup a GIS Job (GUI)</a></li> <li><a href="/datasync/guides/setup-gis-job-headless.html">Setup a GIS Job (Headlessly)</a></li> <li class="nav-header dropdown-header">Additional Resources</li> <li><a href="/datasync/resources/control-config.html">Control File Config</a></li> <li><a href="/datasync/resources/preferences-config.html">Preferences Config</a></li> <li><a href="/datasync/resources/schedule-job.html">Scheduling a Job</a></li> <li><a href="/datasync/resources/checking-log.html">Checking Logs</a></li> <li><a href="/datasync/resources/faq-common-problems.html">FAQ / Common Problems</a></li> <li><a href="/datasync/resources/network-considerations.html">Network Considerations</a></li> <li><a href="/datasync/resources/conditions-restrictions.html">Data Conditions & Restrictions</a></li> <li><a href="/datasync/resources/using-map-fields-dialog.html">Using the Map Fields Dialog</a></li> <li class="nav-header dropdown-header">Developer Guides</li> <li><a href="/datasync/guides/datasync-library-sdk.html">DataSync Library/SDK (Java)</a></li> <li><a href="/datasync/guides/compiling-on-windows-eclipse.html">Compiling on Windows (with Eclipse)</a></li> <li><a href="/datasync/guides/compiling-with-maven.html">Compiling with Maven</a></li> </ul> </li> </ul> </div> </div> <div class="container-fluid content"> <h1 id="title">FAQ / Common Problems</h1> <div class="row with-sidebar"> <div class="col-md-3 hidden-phone"> <div class="well sidebar-nav"> <ul class="nav nav-list sidebar "> <li><a href="/datasync/">Getting Started</a></li> <li class="nav-header dropdown-header">General Guides</li> <li><a href="/datasync/guides/quick-start.html">Quick Start (GUI)</a></li> <li><a href="/datasync/guides/setup-standard-job.html">Setup a Standard Job (GUI)</a></li> <li><a href="/datasync/guides/setup-standard-job-headless.html">Setup a Standard Job (Headlessly)</a></li> <li><a href="/datasync/guides/setup-port-job.html">Setup a Port Job (GUI)</a></li> <li><a href="/datasync/guides/setup-port-job-headless.html">Setup a Port Job (Headlessly)</a></li> <li><a href="/datasync/guides/setup-gis-job.html">Setup a GIS Job (GUI)</a></li> <li><a href="/datasync/guides/setup-gis-job-headless.html">Setup a GIS Job (Headlessly)</a></li> <li class="nav-header dropdown-header">Additional Resources</li> <li><a href="/datasync/resources/control-config.html">Control File Config</a></li> <li><a href="/datasync/resources/preferences-config.html">Preferences Config</a></li> <li><a href="/datasync/resources/schedule-job.html">Scheduling a Job</a></li> <li><a href="/datasync/resources/checking-log.html">Checking Logs</a></li> <li><a href="/datasync/resources/faq-common-problems.html">FAQ / Common Problems</a></li> <li><a href="/datasync/resources/network-considerations.html">Network Considerations</a></li> <li><a href="/datasync/resources/conditions-restrictions.html">Data Conditions & Restrictions</a></li> <li><a href="/datasync/resources/using-map-fields-dialog.html">Using the Map Fields Dialog</a></li> <li class="nav-header dropdown-header">Developer Guides</li> <li><a href="/datasync/guides/datasync-library-sdk.html">DataSync Library/SDK (Java)</a></li> <li><a href="/datasync/guides/compiling-on-windows-eclipse.html">Compiling on Windows (with Eclipse)</a></li> <li><a href="/datasync/guides/compiling-with-maven.html">Compiling with Maven</a></li> </ul> </div> </div> <div class="col-md-9"> <h3 id="what-is-the-id-of-my-dataset">What is the ID of my dataset?</h3> <p>To obtain the dataset ID navigate to the dataset in your web browser and inspect the address bar. The dataset ID can be found at end of the URL in the form (xxxx-xxxx). For example, for the following URL to a dataset:</p> <p>https://data.seattle.gov/Public-Safety/Fire-911/m985-ywaw</p> <p>The dataset ID is: <code class="language-plaintext highlighter-rouge">m985-ywaw</code></p> <h3 id="how-do-i-find-the-api-field-names-for-my-columns">How do I find the API field names for my columns?</h3> <p>Columns within a dataset have both a display name and an API field name. Datasync only operates using API field names. If using the DataSync GUI, you can get the list of API field names by clicking the ‘Get Column IDs’ button after entering the Dataset ID. You may also view the API field names from your browser, by hovering over the information icon on any column.</p> <h3 id="what-datatypes-does-datasync-support">What datatypes does DataSync support?</h3> <p>Datasync supports the Text, Formatted Text, Number, Money, Percent, Date & Time (with or without timezone), Location, Website URL, Email, Checkbox, Flag, Star and Phone datatypes. Please refer to the <a href="/datasync/resources/conditions-restrictions.html">conditions/restrictions resource</a> for formatting requirements of each.</p> <h3 id="datasync-keeps-failing-with-field-not-in-dataset--what-can-i-do-to-fix-this">DataSync keeps failing with “field-not-in-dataset.” What can I do to fix this?</h3> <p>Typically, this is caused for one of three reasons:</p> <ul> <li>You’re referencing the display names in your control file</li> <li>You haven’t specified all of the fields in the dataset.</li> <li>Your CSV contains more columns than the dataset.</li> </ul> <p>To fix the first two bullets, verify that the column names in your control file match the field names in the dataset, and that the list is comprehensive.</p> <p>To fix the latter, either remove the column from your dataset, or use the ignoreColumns option found in the <a href="/datasync/resources/control-config.html">control file</a> guide.</p> <h3 id="my-location-column-is-causing-my-job-to-fail-or-resulting-in-unexpected-data-in-my-address-column">My location column is causing my job to fail, or resulting in unexpected data in my address column</h3> <p>When all fields are not explicitly specified for the location column, the system will attempt to guess at the components by parsing the address. While this parsing normally works there are notable places where it will fail. To work around this, we recommend explicitly breaking out your address locations into consistuent columns (e.g. address, city, state, zip) and then passing those directly to the synthetic location.</p> <h3 id="what-does-this-error-mean-javalangunsupportedclassversionerror-comsocrataexceptionssodaerror--unsupported-majorminor-version-510">What does this error mean? ‘java.lang.UnsupportedClassVersionError: com/socrata/exceptions/SodaError : Unsupported major.minor version 51.0’</h3> <p>Your version of Java is too old, you should update to at least Java 7. Get the <a href="http://www.oracle.com/technetwork/java/javase/downloads/index.html">latest version of Java here</a>.</p> <h3 id="after-running-a-soda2-job-successfully-some-or-all-of-the-columns-in-the-dataset-appear-as-blank-instead-of-the-data-in-the-uploaded-csv">After running a Soda2 job successfully some or all of the columns in the dataset appear as blank instead of the data in the uploaded CSV.</h3> <p>Your header row containing the column names in the dataset does not exactly match the column names in the dataset. Note that the column names are case sensitive. It is best to use the column identifiers (a.k.a. API field names) in your header row, which can be easily obtained for a dataset by clicking the “Get Column ID” button within DataSync.</p> <h3 id="what-does-this-error-mean--certificate-validation-failed">What does this error mean? ‘… certificate validation failed’</h3> <p>If you receive a SunCertPathBuilderException, there are two typical causes:</p> <ol> <li>Java is out-of-date and as a result is failing to validate the SSL certificate. To correct this issue you must update Java JDK or JRE on the machine running DataSync.</li> <li>Java does not approve of one of the certificates in the chain between your machine and the domain you’re trying to upload to. The solution is to add the necessary certificates into Java’s trusted certificate store. The steps to do this are:</li> </ol> <ul> <li>Get the certificate chain. <ul> <li>Find where Java’s keytool is located. <ul> <li>On Windows, this is likely at “C:\Program Files\Java\jre7\bin”)</li> <li>On Mac OS X, this is likely at “/Library/Java/JavaVirtualMachines/jdk1.7.0_45.jdk/Contents/Home/bin/”</li> </ul> </li> <li> <p>Run the following, removing the proxy options if you are not behind a proxy server. You can remove the ‘-rfc’ option to get additional information about each certificate in the chain.</p> <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code> keytool -J-Dhttps.proxyHost=<PROXY_HOST> -J-Dhttps.proxyPort=<PROXY_PORT> -printcert -rfc -sslserver <DOMAIN>:443 </code></pre></div> </div> </li> </ul> </li> <li><strong>Validate any certificates you plan to add with your IT department !!!!</strong>. It is a security risk to add unknown certificates.</li> <li>Copy the cert you need to add inclusively from —–BEGIN CERTIFICATE—– to —–END CERTIFICATE—– into a file <code class="language-plaintext highlighter-rouge"><FILENAME></code>.cer</li> <li> <p>Run the following, using your keystore password if that has been set up or the default password ‘changeit’ otherwise.</p> <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code> keytool -import -keystore cacerts -file <FILENAME>.cer </code></pre></div> </div> </li> </ul> <h3 id="syntheticlocations-is-a-field-why-do-i-get-this-error-unrecognizedpropertyexception-unrecognized-field-syntheticlocations--reference-chain-comsocratadatasyncconfigcontrolfilecontrolfilesyntheticlocations">“syntheticLocations” is a field, why do I get this error? ‘…UnrecognizedPropertyException: Unrecognized field “syntheticLocations” … reference chain: com.socrata.datasync.config.controlfile.ControlFile[“syntheticLocations”]’</h3> <p>This error is because the “syntheticLocations” field is in the wrong level of the control file. It needs to be within the “csv” or “tsv” object, since it contains details about how to interpret the CSV or TSV.</p> <h3 id="my-job-is-failing-because-of-a-corrupt-ssync-patch">My job is failing because of a “Corrupt SSync patch”</h3> <p>This error is most likely caused by insufficient heap space. Try starting up DataSync with additional heap space using one of the options below:</p> <div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>java -jar -Xmx500m <DATASYNC_JAR> java -jar -Xmx1g <DATASYNC_JAR> </code></pre></div></div> <p>The former allows java to use 500 MB of space and the latter 1 GB of space. If the problem persists please contact your Socrata representive for support.</p> <h3 id="i-am-getting-an-invalidcorrupt-jar-file-message-when-trying-to-open-jar">I am getting an ‘invalid/corrupt JAR file’ message when trying to open JAR</h3> <p>Redownload the DataSync JAR from: <a href="https://github.com/socrata/datasync/releases">https://github.com/socrata/datasync/releases</a></p> <h3 id="how-do-i-use-datasync-to-accept-any-datetime-format">How do I use DataSync to accept any date/time format?</h3> <p>This is only possible in DataSync version 1.0 and higher. Refer to <a href="http://socrata.github.io/datasync/resources/control-config.html#date-time">this documentation</a>.</p> <h3 id="im-getting-a-connection-refused-error--im-having-network-problems">I’m getting a ‘Connection refused’ error / I’m having network problems.</h3> <p>Please reference our <a href="/datasync/resources/network-considerations.html">Network Considerations resource</a>.</p> <h3 id="im-still-stuck--what-can-i-do">I’m still stuck. What can I do?</h3> <p>Verify that your CSV meets all of the restrictions detailed in the <a href="/datasync/resources/conditions-restrictions.html">conditions and restrictions</a> guide. If you are still having trouble, please contact your Socrata representive for support.</p> <div class="related-pages"></div> </div> </div> <footer class="muted"> <hr /> <a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/3.0/deed.en_US"> <img alt="Creative Commons License" src="https://licensebuttons.net/l/by-nc-sa/3.0/80x15.png" /> </a> Licensed by <a xmlns:cc="http://creativecommons.org/ns#" href="http://www.socrata.com" property="cc:attributionName" rel="cc:attributionURL">Socrata</a> under <a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/3.0/deed.en_US">CC BY-NC-SA 3.0</a>. Learn how <a href="/datasync/contributing.html">you can contribute!</a> </footer> </div>  </body> </html>