Differences

This shows you the differences between two versions of the page.

--- projects:sget [2025/03/14 11:35] – darron
+++ projects:sget [2025/03/14 12:39] (current) – [Install] darron
@@ Line 1: / Line 1: @@
+====Selenium get====
+This is a simple tool to fetch a page using selenium and allow
+access to its wait parameters.
+===Install===
+<code>
+sudo apt install python3-full mercurial
+hg clone https://hg.kewl.org/pub/sget
+cd sget
+</code>
+[[https://hg.kewl.org/pub/sget/file/tip/sget.py|script]]
 ===Demo===
+This web page loads a page of temporary content and after a delay it will reload.
+The reloaded content contains a subset of the full content and requires scrolling to
+reveal it all.
+Fetch the temporary page
 <code>
 py sget.py "https://www.deckenmalerei.eu/e8a3bf28-6365-42fe-a4d3-41608ed870e8" d0.html
+</code>
+Fetch the reloaded page
+<code>
 py sget.py "https://www.deckenmalerei.eu/e8a3bf28-6365-42fe-a4d3-41608ed870e8" -d10 d10.html
 </code>
+Compare temporary and reloaded
 <code>
 diff d0.html d10.html | head -30
@@ Line 40: / Line 65: @@
 </code>
+Fetch the page again but this time wait for the reloaded content based on tag attribute
 <code>
-py sget.py "https://www.deckenmalerei.eu/e8a3bf28-6365-42fe-a4d3-41608ed870e8" -b XPATH -v "//div[@class='dataPage']" dataPage.html
+py sget.py "https://www.deckenmalerei.eu/e8a3bf28-6365-42fe-a4d3-41608ed870e8" -b XPATH -v "//div[@class='dataPage']" --scroll dataPage.html
 </code>