Skip to content

Commit

Permalink
Deploying to pages from @ 4f4b6da 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
d33bs committed Mar 16, 2024
1 parent b1409c0 commit 0c025ee
Showing 1 changed file with 0 additions and 14 deletions.
14 changes: 0 additions & 14 deletions _modules/cytotable/convert.html
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,6 @@ <h1>Source code for cytotable.convert</h1><div class="highlight"><pre>
<span class="sd">CytoTable: convert - transforming data for use with pyctyominer.</span>
<span class="sd">&quot;&quot;&quot;</span>


<span class="kn">import</span> <span class="nn">itertools</span>
<span class="kn">import</span> <span class="nn">logging</span>
<span class="kn">import</span> <span class="nn">uuid</span>
Expand Down Expand Up @@ -876,19 +875,6 @@ <h1>Source code for cytotable.convert</h1><div class="highlight"><pre>
<span class="k">if</span> <span class="n">pathlib</span><span class="o">.</span><span class="n">Path</span><span class="p">(</span><span class="n">dest_path</span><span class="p">)</span><span class="o">.</span><span class="n">is_dir</span><span class="p">():</span>
<span class="n">shutil</span><span class="o">.</span><span class="n">rmtree</span><span class="p">(</span><span class="n">path</span><span class="o">=</span><span class="n">dest_path</span><span class="p">)</span>

<span class="c1"># write the concatted result as a parquet file</span>
<span class="n">_write_parquet_table_with_metadata</span><span class="p">(</span>
<span class="n">table</span><span class="o">=</span><span class="n">pa</span><span class="o">.</span><span class="n">concat_tables</span><span class="p">(</span>
<span class="n">tables</span><span class="o">=</span><span class="p">[</span>
<span class="n">parquet</span><span class="o">.</span><span class="n">read_table</span><span class="p">(</span>
<span class="n">table_path</span><span class="p">,</span> <span class="n">memory_map</span><span class="o">=</span><span class="n">CYTOTABLE_ARROW_USE_MEMORY_MAPPING</span>
<span class="p">)</span>
<span class="k">for</span> <span class="n">table_path</span> <span class="ow">in</span> <span class="n">join_sources</span>
<span class="p">]</span>
<span class="p">),</span>
<span class="n">where</span><span class="o">=</span><span class="n">dest_path</span><span class="p">,</span>
<span class="p">)</span>

<span class="c1"># build a parquet file writer which will be used to append files</span>
<span class="c1"># as a single concatted parquet file, referencing the first file&#39;s schema</span>
<span class="c1"># (all must be the same schema)</span>
Expand Down

0 comments on commit 0c025ee

Please sign in to comment.