Open Research Tools and Technologies Devroom
Guillaume Plique, SciencesPo médialab
You need to know The Web™:
DNS HTTP HTML CSS JS DOM AJAX SSR CSR XPATH ...
It really is a craftsmanship.
Browsers truly are heuristical wonders!
Once we cut access to Google to our whole university!
Most of it is irrelevant and made up but you get the point...
By designing tools suited to their research questions
Not-contractual logo - Jules Farjas ©
Do one thing well
xsv search -s url urls.csv | minet fetch url -d html > result.txt
Jupyter's back y'all!
from minet import multithreaded_fetch
for result in multithreaded_fetch(urls_iterator):
We need to be able to design user paths.
What about a GUI for minet?
Note: Google Trends example
Note: anecdote about the Selenium researchers
Note: used for several hit jobs
Note: used for polarisation