Skip to content

Commit

Permalink
Merge pull request #6 from Imageomics/infrastructure-info
Browse files Browse the repository at this point in the history
Add infrastructure info
  • Loading branch information
egrace479 authored Nov 19, 2024
2 parents eca9e5a + e896f67 commit 7ddb995
Show file tree
Hide file tree
Showing 4 changed files with 43 additions and 1 deletion.
22 changes: 21 additions & 1 deletion docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,30 @@ Discover new tools to help:

- [Virtual Environments](wiki-guide/Virtual-Environments.md): Summary of `conda` and `pip` environments: how to make, use, and share them.

### Other pages of note

## Collaborative Infrastructure We Use

- GitHub
- [Institute Code Repositories](https://github.com/Imageomics) where we store our code (software + tools).
- GitHub's [Docs](https://docs.github.com/en)
- [Repositories](https://docs.github.com/en/repositories)
- [GitHub Projects](https://docs.github.com/en/issues/planning-and-tracking-with-projects)
- Hugging Face
- [Imageomics Organization page](https://huggingface.co/imageomics) where we store our datasets and models (and their metadata).
- Additionally, use [Hugging Face Spaces](https://huggingface.co/docs/hub/spaces) to run demos of models and other projects.
- Hugging Face's [Docs](https://huggingface.co/docs)
- [Model Hub](https://huggingface.co/docs/hub/models-the-hub)
- [Datasets](https://huggingface.co/docs/hub/datasets-overview)

### Collaborative Infrastructure Diagram
![tech_infrastructure_diagram](wiki-guide/images/index/382108831-1173cd79-db94-4326-8b6e-dcbdeb8939cd.png)


## Other pages of note
- [Glossary for Imageomics](wiki-guide/Glossary-for-Imageomics.md): Collection of terms used in imageomics. The goal is to ensure all participating domains are represented, thus facilitating interdisciplinary communication. This is a group effort, please check it out and add terms you think should be there!
- [Command Line Cheat Sheet](wiki-guide/Command-Line-Cheat-Sheet.md): Collection of useful bash, emacs, and git commands.


<br>
<br>

Expand Down
21 changes: 21 additions & 0 deletions docs/wiki-guide/Technical-Infrastructure.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Compute Infrastructure We Use

## Overview
Overall [Infrastructure Chart](https://docs.google.com/spreadsheets/d/1JSOi5pp2Y8Utj_npzKcYmvAxGncgmvP2gait5H0oYKk/edit?usp=sharing) with system specifications and notes.

- [The Ohio Supercomputing Center (OSC)](https://www.osc.edu/): Large compute resource accessible through `ssh` or OnDemand (web) platform.
- [Globus Endpoint](https://www.globus.org/) — this is the preferred transfer method for collaborations, especially for large data.
- OnDemand page: [info](https://www.osc.edu/resources/online_portals/ondemand), [login]( https://ondemand.osc.edu)
- myOSC client portal: [info](https://www.osc.edu/supercomputing/portals/client_portal), [login](https://my.osc.edu/acprod/odb_osc/r/osc/portal/login_desktop?clear=101)
- Imageomics dedicated GPU server: _Internal_ server, hosts our CVAT instance.
- [Usage and access guide (_internal_ )](https://github.com/Imageomics/internal-guidelines/wiki/Imageomics-GPU-Server)
- [CVAT user guide](https://github.com/Imageomics/kabr-tools/wiki/CVAT-User-Guide)
- NSF ACCESS Accelerate Allocation: NCSA Delta GPU credits
- [Amazon Web Services (AWS)](https://aws.amazon.com/?nc2=h_lg): Basic to extremely powerful, abundant (though finite) resources, high cost.
- Used sparingly for urgent deadlines when other compute is not available (generally hasn't been available at those times either, though) or to host projects that cannot be hosted effectively through a Hugging Face Space.
- [AWS usage guidelines (_internal_ )](https://github.com/Imageomics/internal-guidelines/wiki/AWS-@-Imagomics)

# Other Compute Resources We've Used or Considered

- OpenAI Researcher Access Program
- NAIRR Pilot Program
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions mkdocs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -85,4 +85,5 @@ nav:
- "Glossary for Imageomics": wiki-guide/Glossary-for-Imageomics.md
- "Handling API Keys": wiki-guide/Handling-API-Keys.md
- "Helpful Tools": wiki-guide/Helpful-Tools-for-your-Workflow.md
- "Technical Infrastructure": wiki-guide/Technical-Infrastructure.md
- "Virtual Environments": wiki-guide/Virtual-Environments.md

0 comments on commit 7ddb995

Please sign in to comment.