In order to retrieve and import GitHub repositories, you will need a GitHub personal access token, as demonstrated earlier.
Using a GitLab rake task
Preparing GitLab for import
For importing projects using a rake task, there is only one option to configure in GitLab beforehand: the number of Sidekiq resources. You will notice that for big projects, it can take quite some time to import all the data. To speed up this process, assign more Sidekiq workers to the following queues:
- github_importer
- github_importer_advance_stage
For GitLab omnibus installations, these queues are part of the default Sidekiq process. Giving more threads to Sidekiq will mean that there will be more workers:
# sidekiq['concurrency'] = 25
...