archive.html (1654B)
1 <!DOCTYPE html> 2 <html lang="en"> 3 <head> 4 <meta charset="utf-8"> 5 <title>IslamQA.info and Ahadith Archive | Riaz's Website</title> 6 <link rel="stylesheet" href="/style.css"> 7 <link rel="icon" href="data:,"> 8 <meta name="description" content="Archive of IslamQA.info's English answers and ahadith in plain text"> 9 <meta name="viewport" content="width=device-width, initial-scale=1"> 10 </head> 11 <body> 12 <h1>IslamQA.info and Ahadith Archive</h1> 13 <hr> 14 <article> 15 <p>In April, I uploaded all English answers from IslamQA.info to archive.org. My account was removed, so they are provided below.</p> 16 <ul> 17 <li><a href="/files/islamqa.txt.zip">islamqa.info (plain text, 29M)</a></li> 18 <li><a href="/files/islamqa.html.zip">islamqa.info (HTML, 339M)</a></li> 19 <li><a href="/files/ahadith.txt">Ahadith (plain text, 20M)</a></li> 20 </ul> 21 <p>The URLs were taken from https://islamqa.info/sitemaps/en/answers/1/sitemap.xml. archive-1446 was used rather than the main site since its HTML is smaller. Running overnight, downloading took three hours.</p> 22 <pre>wget -i urls.txt --continue --tries=3 --wait=0.1 --random-wait --limit-rate=50m --directory-prefix=downloads</pre> 23 <p>It took under ten minutes to run <code>find -type f -not -name "*.txt" -exec sh -c 'w3m -T text/html -cols 9999 "$1" > "$1.txt"' echo {} \;</code>. The text files were stripped using <code>sed -i '1,/^Question$/ d; /^share Question$/,$ d' *.txt</code>.</p> 24 <p>The ahadith were taken from https://github.com/samiulahmedjoy/hadith/raw/refs/heads/main/main-hadith.txt. Many line breaks were removed, bringing down the file size.</p> 25 </article> 26 <footer> 27 <hr> 28 <a href="/">Home Page</a></footer> 29 </body> 30 </html>