Skip to content

Mariner Issue Collector helps you identify freshly opened issues across all open source projects you care about. Use Mariner to help you identify contribution opportunities in your open source dependencies!

License

Notifications You must be signed in to change notification settings

indeedeng/Mariner-Issue-Collector

Repository files navigation

Mariner Issue Collector

OSS Lifecycle

Mariner Issue Collector is a live demo that implements the Mariner library. This demo is configured to run automatically as a GitHub Action.

Mariner helps you identify recently opened issues in a list of GitHub repositories that you provide. We use Mariner at Indeed to identify beginner-friendly issues that were recently opened in open source projects that we depend on.

Getting Started

Running the Mariner Issue Collector requires a few steps.

Step 1 : Update the list of repos

Update the inputData file with repositories and the issueLabels file with issue labels you're interested in. We have successfully tested this file with nearly 10,000 repos, which ran in about 15 minutes.

The inputData.json file should be a JSON object with "owner/repo" as key, and a numeric value that represents the "weight" of the repository.

The issueLabels.json file should be a JSON array containing issue labels as strings.

The numerical weights assigned to each repo in the inputData.json file determine the order in which results are listed. Weight should be assigned according to importance to you (e.g. how often a dependency is used in your organization). Results are returned in descending order with the greatest weight listed first. If all weights are equal the results will be listed in the order they appear in the inputData.json object.

Step 2 : Set environment variables

At a minimum, the demo app will expect you to have set a MARINER_GITHUB_TOKEN environment variable, containing an auth token for the GitHub API. Other environment variables, and their default values, are shown below.

MARINER_GITHUB_TOKEN: Your Auth Token
MARINER_LABELS_FILE_PATH: "./InputFiles/issueLabels.json"
MARINER_INPUT_FILE_PATH: "./InputFiles/inputData.json"
MARINER_OUTPUT_FILE_PATH: "./OutputFiles/outputData.json"
MARINER_MARKDOWN_FILE_PATH: "./OutputFiles/githubMarkdown.md"
MARINER_MAX_ISSUES_AGE: "30"

MARINER_MAX_ISSUES_AGE sets a limit on the age of issues to be returned, measured in days. You can change it to reflect your desired scope.

Step 3 : Run Mariner

Start by downloading dependencies:

npm ci

Run the findIssues.js script:

node findIssues.js

This will update the outputData file with any issues that Mariner finds.

The query will return only the data that you specify in the input files. GitHub will automatically paginate results in sets of 30. Mariner will then walk through the paginated results.

Optionally, generate markdown based on the new set of issues:

node Utilities/generateGitHubMarkdown.js

This will parse the outputData.json file and update the githubMarkdown with a list of issues that can be easily viewed on GitHub.

Or generate markdown for use in Confluence/Jira:

node Utilities/generateConfluenceMarkdown.js

In Jira, simply copy and paste the contents of confluenceMarkdown into the text mode of the editor.

Also, generate static HTML file that shows the new issues:

node Utilities/generateHtml.js

This will parse the outputData.json file and update the Issues.html with the list of issues.

Mariner Issue Collector As A GitHub Action

Mariner ships with a default GitHub Action that runs every 8 hours to generate a fresh issue list, and commit that issue list back into the GitHub repository. Any fork of this repository will automatically include this action, as it is triggered by the existence of the action YAML file.

Use Mariner Issue Collector In A Private Repo

To use the demo app in a private repo, you will need to create a bare clone of the public project.

git clone --bare https://github.com/indeedeng/Mariner-Issue-Collector

Next, you will need to move into the clone directory and mirror-push to your private repository.

cd Mariner-Issue-Collector.git
git push --mirror https://github.com/YourUserName/YourPrivateRepo

You can then remove the public clone.

cd ..
rm -rf Mariner-Issue-Collector.git

Finally, clone the private repo on your local machine to begin using.

git clone https://github.com/YourUserName/YourPrivateRepo

Getting Help

If you need help or find bugs, please open an issue.

How To Contribute

If you see an open issue that you would like to work on, please make sure the issue has the "unclaimed" tag, and that there are no open pull requests for the issue.

If an issue has the "unclaimed" tag, and you would like to claim it, comment on the issue. A maintainer will add the "claimed" tag to the issue and indicate to whom it has been assigned.

If you want to propose a new feature, please open an issue and tell us about the contribution you'd like to make.

Regarding Hacktoberfest: We will only tag pull requests with "hacktoberfest accepted" if:

  • The pull request references a claimed issue with the Hacktoberfest label
  • The pull request was submitted by the person who claimed the issue

Project Maintainers

This project is primarily maintained by @DuaneOBrien.

Code of Conduct

This project is governed by the Contributor Covenant v 1.4.1

License

This project uses the MIT license.

About

Mariner Issue Collector helps you identify freshly opened issues across all open source projects you care about. Use Mariner to help you identify contribution opportunities in your open source dependencies!

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks