I’m trying to do develop a machine translation model and train it using the source code of all the apps in the official F-Droid repo. I did come across this topic:How can I download all the apps in F-Droid repository but the stated solution using fdroidcl downloads apps as APKs and I want the source code of each of the apps. Does anyone know of an automated way or a package using which I can download the source code of all the apps in the official f-droid repo (preferably through Linux command line)?
I downloaded the file and ran the command and it does indeed show a url to all of the apps but nothing was downloaded apparently. In which location can I find these files?
These are just the URLs which you need to download.
But I would use a simpler command: rsync -a --info=progress2 --human-readable 'rsync://ftp.fau.de/fdroid/repo/*' --include='*_src.tar.gz' --exclude='*' destination_dir
These are around 50GiB, so this needs some time.
You can also use a different rsync mirror.
Here is a list: F-Droid - https://f-droid.org/repo/ - Repo details
This works great! Is it possible to only get the latest version of the app instead of multiple versions of the same app through this? It won’t make much of a difference having all versions of the app in my case and it would take less time too.
Mass downloads should happen via rsync from the mirrors. Many of the mirrors support rsync. And if you are downloading this to a machine outside of the EU, consider offering a local mirror: