benchmarks.html

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <title>CSV import benchmarks: Scriptella</title>
  <meta name="description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with completed benchmark v4 GitHub Actions results.">
  <link rel="canonical" href="https://scriptella.org/benchmarks.html">
  <meta property="og:title" content="CSV import benchmarks: Scriptella">
  <meta property="og:description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with completed benchmark v4 GitHub Actions results.">
  <meta property="og:type" content="website">
  <meta property="og:url" content="https://scriptella.org/benchmarks.html">
  <meta property="og:image" content="https://scriptella.org/images/scriptella-og.png">
  <meta property="og:image:type" content="image/png">
  <meta property="og:image:alt" content="Scriptella">
  <meta property="og:image:width" content="1731">
  <meta property="og:image:height" content="909">
  <meta name="twitter:card" content="summary_large_image">
  <meta name="twitter:image" content="https://scriptella.org/images/scriptella-og.png">
  <meta name="twitter:title" content="CSV import benchmarks: Scriptella">
  <meta name="twitter:description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with completed benchmark v4 GitHub Actions results.">
  <link rel="icon" href="favicon.ico" sizes="32x32">
  <link rel="icon" type="image/png" href="favicon-192.png" sizes="192x192">
  <script src="theme.js"></script>
  <link rel="stylesheet" href="style.css?v=20261022">
</head>
<body>
  <a class="skip-link" href="#main-content">Skip to content</a>
  <header class="site-header">
    <nav class="primary-nav" aria-label="Primary navigation">
      <div class="site-header__inner">
        <a class="site-logo" href="index.html" aria-label="Scriptella home">
          <img class="site-logo__dark" src="images/scriptella-logo.svg" width="190" height="38" alt="Scriptella">
          <img class="site-logo__light" src="images/scriptella-logo-light.svg" width="190" height="38" alt="Scriptella">
        </a>
        <ul>
          <li><a href="reference/index.html">Documentation</a></li>
          <li><a href="tutorial.html">Tutorial</a></li>
          <li><a href="installation.html">Install</a></li>
          <li><a href="download.html">Download</a></li>
          <li><a href="https://github.com/scriptella/scriptella-etl">GitHub</a></li>
        </ul>
        <div class="header-controls">
        <button class="theme-toggle" type="button" data-theme-toggle data-theme-current="system" aria-label="Color theme: System. Switch to Light." title="System theme: switch to Light">
          <span class="visually-hidden">Change color theme</span>
        </button>
        </div>
      </div>
    </nav>
  </header>

  <main id="main-content" class="page-shell page-shell--reading">
    <article class="page-content">
      <h1>CSV import benchmarks</h1>
      <p>For practical configuration advice, see the <a href="https://github.com/scriptella/scriptella-etl/blob/master/docs/batching-performance.md">batching and insert performance guide</a>, covering PostgreSQL and MariaDB driver settings, batch sizes, and transaction boundaries.</p>
      <p class="lede">One million rows, two databases, and a reproducible comparison of Scriptella 1.6, handwritten JDBC, and csvsql.</p>
      <p>Batched Scriptella imported the fixture in 7.775 seconds on PostgreSQL and 6.694 seconds on MariaDB in one GitHub Actions run. Handwritten JDBC was faster; csvsql’s tested direct-import workflow took about 6 minutes.</p>
      <p>These are exploratory results for this workload and environment. JDBC batching and csvsql chunking use different mechanisms; PostgreSQL COPY is a database-specific reference.</p>

      <h2 id="ci-results">Benchmark v4 results</h2>
      <p>The full v4 comparison, including csvsql, completed successfully on October 21, 2026. The charts show single observations from that Ubuntu 24.04 x86_64 run. Lower is faster.</p>
      <figure>
        <img src="images/benchmarks/v4-ci-postgres.svg" width="879" height="447" alt="PostgreSQL durations: Scriptella batch 1000 7.775 seconds, JDBC batch 1000 6.320 seconds, csvsql chunk 1000 378.555 seconds, and native COPY 1.401 seconds.">
        <figcaption>PostgreSQL: logarithmic duration axis. Read the printed seconds for absolute differences.</figcaption>
      </figure>
      <figure>
        <img src="images/benchmarks/v4-ci-mariadb.svg" width="879" height="447" loading="lazy" alt="MariaDB durations: Scriptella batch 1000 6.694 seconds, JDBC batch 1000 4.465 seconds, and csvsql chunk 1000 370.594 seconds.">
        <figcaption>MariaDB: logarithmic duration axis. Read the printed seconds for absolute differences.</figcaption>
      </figure>
      <p><small>Benchmark <strong>v4</strong>, Scriptella 1.6. PostgreSQL explicitly enables <code>reWriteBatchedInserts=true</code> for both Scriptella and handwritten JDBC; MariaDB uses driver defaults. Scriptella’s general adapter default is unchanged. These are single observations, not repeated-run medians. RAM was not measured.</small></p>
      <p>See the <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-21-ci-v4">full v4 results and environment details</a>, including all eleven cases, unbatched imports, and raw measurements, and the <a href="https://github.com/scriptella/scriptella-benchmarks/actions/runs/39688830534">successful CI run</a>.</p>

      <h2 id="method">About the comparison</h2>
      <p>All import paths load the same CSV into a pre-created table, with one transaction per import and no indexes or transformations. Timings include client startup, parsing, insertion, and commit; setup and verification are excluded. Every measured import passed independent row-count and sampled-value checks.</p>
      <p>The experiment uses Scriptella 1.6, Java 17, csvsql 2.2.0, PostgreSQL 17.11 with pgJDBC 42.7.13, and MariaDB 11.8.8 with Connector/J 3.5.7. Database durability uses normal defaults. See the <a href="https://github.com/scriptella/scriptella-benchmarks/blob/main/docs/benchmark-guide.md">methodology and limitations</a> for the full comparison.</p>
      <p>GitHub-hosted hardware and load vary between runs. These results do not establish an improvement over historical measurements. A separate <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-21-pg-rewrite">repeated local comparison of PostgreSQL batch rewriting</a> measures the effect of that setting with rewriting off and on.</p>

      <h2 id="historical-results">Historical results</h2>
      <p>Earlier benchmark definitions and environments are documented separately: <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-14-ci-v3">v3 CI results</a>, <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-13-ci">v2 CI results</a>, and <a id="local-results" href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-12-local">v2 local results</a>. Results from different versions and environments are not pooled.</p>

      <h2 id="reproduce">Run it yourself</h2>
      <p>The benchmark runs with Docker Compose and includes all dependencies. The <a href="https://github.com/scriptella/scriptella-benchmarks#reproduce">repository instructions</a> cover running the comparison, inspecting results, and repeating it on your own hardware.</p>

      <!-- GitHub star prompt: keep in sync with github-prompt.html -->
      <aside class="github-prompt" aria-label="Support Scriptella">
        <p>Scriptella useful? <a href="https://github.com/scriptella/scriptella-etl">Star it on GitHub</a> to help others discover it.</p>
      </aside>
    </article>
  </main>

  <footer class="site-footer">
    <div class="site-footer__inner">
      <p><strong>Scriptella</strong> · Licensed under the Apache License, Version 2.0.</p>
      <p class="site-footer__credit">Built by <a class="pvrlabs-wordmark" href="https://pvrlabs.xyz" aria-label="PVR Labs"><span class="pvrlabs-wordmark__accent">PVR</span><span class="pvrlabs-wordmark__light">Labs</span></a></p>
      <nav aria-label="Footer navigation">
        <ul>
          <li><a href="reference/index.html">Documentation</a></li>
          <li><a href="faq.html">FAQ</a></li>
          <li><a href="docs/api/index.html">API Docs</a></li>
          <li><a href="docs/dtd/index.html">DTD Reference</a></li>
          <li><a href="https://github.com/scriptella/scriptella-etl">GitHub</a></li>
          <li><a href="benchmarks.html">Benchmarks</a></li>
          <li><a href="changes.html">Change History</a></li>
          <li><a href="license.html">License</a></li>
          <li><a href="support.html">Support</a></li>
        </ul>
      </nav>
    </div>
  </footer>
  <!-- StatCounter: existing Scriptella project configuration -->
  <script>
    var sc_project = 10775960;
    var sc_invisible = 1;
    var sc_security = "53eaed1c";
  </script>
  <script defer src="https://secure.statcounter.com/counter/counter.js"></script>
  <!-- End StatCounter -->
</body>
</html>