added method image

fraunhoferhhi · Jul 23, 2024 · 4319880 · 4319880
1 parent 2d9b1db
commit 4319880
Show file tree

Hide file tree

Showing 2 changed files with 27 additions and 0 deletions.
diff --git a/project-page/index.html b/project-page/index.html
@@ -166,6 +166,33 @@ <h2 class="title is-3">Examples</h2>
       </div>
     </section>
 
+    <section class="section hero is-small">
+      <div class="container is-max-desktop">
+        <div class="columns is-centered has-text-centered">
+          <div class="column is-four-fifths">
+            <h2 class="title is-3">Method</h2>
+            <div class="content has-text-justified">
+              <p>
+				The content of the query image is searched <i>inside</i> the semantic panorama rendering via cross-domain image-to-panorama matching. First, both inputs are encoded with CNN backbones, then the feature tensors are interwoven via depth-wise correlations and multiple tensor operations. This matching is inspired by <a href="https://openaccess.thecvf.com/content/WACV2021/html/Mercier_Deep_Template-Based_Object_Instance_Detection_WACV_2021_paper.html">DTOID</a>, a generic 2D object instance detection approach.
+				</p>
+				<p>
+				The correlated features R&#42; are fed into multiple network heads, which estimate the binary mask corresponding to the viewport of the camera in the panorama, the 2D bounding box enclosing the estimated viewport mask, and the relative 6D pose offset between the camera image and the panorama. The key point is that each match is given a score via the bounding box estimation, which can be used to select the best match from a large number of reference panoramas. The absolute pose is determined from the estimated relative pose between this panorama and the camera image.
+				</p>
+				</div>
+          </div>
+        </div>
+      </div>
+    </section>
+
+    <section class="hero is-small">
+      <div class="hero-body">
+        <div class="container">
+        <img style="display: block; margin-left: auto; margin-right: auto; width: 80%" src="static/images/matching.png" alt="Matching of spvloc" />
+        </div>
+      </div>
+    </section>
+
+
     <!--BibTex citation -->
     <section class="section" id="BibTeX">
       <div class="container is-max-desktop">

diff --git a/project-page/static/images/matching.PNG b/project-page/static/images/matching.PNG