Skip to content

Commit 24f71a1

Browse files
committed
updated db
1 parent da1878a commit 24f71a1

62 files changed

Lines changed: 414 additions & 5 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

script/ingestion/dcc.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,8 @@
4545
for k,v in row.items():
4646
if not new_row[k] == v:
4747
if type(new_row[k]) == str and not (new_row[k].replace("https://cfde-drc.s3.amazonaws.com/assets/img/", "/img/") == v):
48-
raise(Exception("key %s not the same, expected %s got %s"%(k, v, new_row[k])))
48+
# raise(Exception("key %s not the same, expected %s got %s"%(k, v, new_row[k])))
49+
print("key %s not the same, expected %s got %s"%(k, v, new_row[k]))
4950

5051
## Update S3
5152
backup_file(df, "dccs")

script/ingestion/publications.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@
2626
for k,v in partnerships.iterrows():
2727
partnership_mapper[v["title"]] = k
2828

29+
print(partnership_mapper)
2930
r03 = pd.read_csv('https://cfde-drc.s3.amazonaws.com/database/files/current_r03s.tsv', sep="\t", index_col=0)
3031
r03_mapper = {}
3132
for k,v in r03.iterrows():

script/ingestion/tools.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,11 +32,14 @@
3232
doi = v.replace("https://doi.org/", "")
3333
pub_id = publication_mapper[doi]
3434
publication_df.at[pub_id, 'tool_id'] = uid
35-
elif k not in ["layout", "id", "tutorial"]:
35+
elif k not in ["layout", "id", "tutorial", "tags"]:
3636
val[k] = v
3737
elif k == "tutorial":
3838
val[k] = json.dumps(v)
3939
print(val[k], type(v))
40+
elif k == "tags":
41+
val[k] = json.dumps(v)
42+
print(val[k], type(v))
4043

4144
tools[uid] = val
4245

script/ingestion/usecase.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,8 @@
3636
"image": row.get("image"),
3737
"tutorial": row.get("tutorial"),
3838
"featured": row.get("featured"),
39-
"creator_dcc_id": dcc_mapper[row["creator_dcc"][0]],
39+
"tags": json.dumps(row.get('tags'))
40+
# "creator_dcc_id": dcc_mapper.get(row["creator_dcc"][0], ""),
4041
}
4142
if row.get("source_dcc"):
4243
for dcc in set([dcc_mapper[i] for i in row["source_dcc"]]):
@@ -118,4 +119,5 @@
118119
'''%(column_string, column_string))
119120
cur.execute('drop table dcc_usecase_tmp;')
120121
connection.commit()
122+
print("Ingested")
121123

src/pages/centers/CWIC.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,5 +22,6 @@ press_release:
2222
url: https://www.hpcwire.com/off-the-wire/tacc-receives-nih-award-to-develop-cloud-workspace-implementation-center/
2323
layout: '@/layouts/Center.astro'
2424
short_description: The CFDE Cloud Workspace enables researchers to analyze, integrate, and share data with powerful tools, fostering collaboration and accelerating discoveries through free computational resources and training.
25+
icon: /centers/CWIC.png
2526
---
2627
The CFDE Cloud Workspace is designed to provide researchers with an accessible and collaborative environment for data analysis. It allows users to import and integrate data with Common Fund datasets while utilizing a wide range of analysis tools, workflows, and pipelines. The Cloud Workspace Implementation Center (CWIC) streamlines deployment by leveraging key partnerships: TACC’s high-performance computing resources, Galaxy’s open-source interface for data analysis, and CloudBank’s tools for simplified cloud access and billing. <br/><br/>This workspace supports both novice and expert users by offering training, outreach, and cost-management tools to optimize resource usage. Users will have access to a variety of tools developed by CFDE, Galaxy, and other partners, with the flexibility to incorporate custom or third-party tools. By providing free storage and compute resources, the Cloud Workspace lowers barriers to entry, enabling researchers to work with large datasets and complex analyses.<br/><br/>By fostering data sharing, collaboration, and ease of access, CWIC accelerates biomedical research and supports a broader scientific community in tackling high-priority challenges. This initiative represents a significant step toward expanding access to advanced computational resources and empowering researchers to drive innovation in the field.

src/pages/centers/TC.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,5 +17,6 @@ institution:
1717
layout: '@/layouts/Center.astro'
1818
homepage: 'https://orau.org/cfde-trainingcenter/index.html'
1919
short_description: The CFDE Training Center will expand data accessibility by providing tailored training, mentoring, and outreach, fostering a diverse learning community to enhance biomedical research and data use.
20+
icon: /centers/TC.svg
2021
---
2122
In coordination with other CFDE Centers and funded programs and projects, the Training Center (TC) acts as a central hub to provide a comprehensive approach to support current and potential CFDE users on their learning journey. It aims to expand the CFDE data userbase and enhance the confidence and complexity of dataset usage through community building and engagement activities.<br/><br/><br/> The TC will provide training in basic and advanced computational and data analytic skills for data science learners and users to engage meaningfully with CFDE data and tools in research and increase awareness and attract new users from the bioinformatics, data science, and research communities through a variety of initiatives internal and external to the CFDE, including attendance at conferences and other activities and opportunities.

src/pages/dccs/HMP.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
active: true
33
cf_site: https://commonfund.nih.gov/HMP
44
cfde_partner: true
5-
homepage: https://portal.hmpdacc.org/
5+
homepage: https://www.hmpdacc.org/hmp/resources/
66
icon: https://cfde-drc.s3.amazonaws.com/assets/img/HMP.png
77
label: The Human Microbiome Project
88
layout: '@/layouts/DCC.astro'
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
---
2+
active: true
3+
carousel: false
4+
cfde_specific: true
5+
end_date: '2026-10-21:16:00-05:00'
6+
featured: true
7+
image: https://cfde-drc.s3.us-east-2.amazonaws.com/assets/img/b2aifall2026.png
8+
layout: '@/layouts/Outreach.astro'
9+
link: https://web.cvent.com/event/3f4cbe6f-4006-4f79-a2ba-2c4fbf77bae3/summary
10+
short_description: "The Fall 2026 All-Hands Meeting and Open House will highlight significant advances made in the program and highlight some of the breakthroughs by the program teams. Join us to connect with consortium members, discover new resources, and gain hands-on experience with the datasets, tools, and processes driving the future of biomedical AI."
11+
start_date: '2026-10-20T08:45:00-05:00'
12+
tags: '["face to face meeting"]'
13+
title: Bridge2AI 2026 All-Hands Meeting
14+
dcc:
15+
- Bridge2AI
16+
---
17+
The Fall 2026 All-Hands Meeting and Open House will highlight significant advances made in the program and highlight some of the breakthroughs by the program teams. Join us to connect with consortium members, discover new resources, and gain hands-on experience with the datasets, tools, and processes driving the future of biomedical AI.
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
---
2+
active: true
3+
carousel: true
4+
cfde_specific: true
5+
end_date: '2026-04-24T14:00:00-05:00'
6+
featured: false
7+
image: https://cfde-drc.s3.us-east-2.amazonaws.com/assets/img/webinar042426.png
8+
layout: '@/layouts/Outreach.astro'
9+
link: https://broadinstitute.zoom.us/webinar/register/WN_x0bGLLt4TbqFGlxlMM-T2A
10+
short_description: "An introduction to protein knowledge network (ProKN) and use cases integration of ProKN & CFDE in NSF Proto-OKN initiative"
11+
start_date: '2026-04-24T13:00:00-05:00'
12+
tags: '["webinar"]'
13+
title: CFDE Webinar Series
14+
15+
---
16+
An introduction to protein knowledge network (ProKN) and use cases integration of ProKN & CFDE in NSF Proto-OKN initiative
Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
---
2+
active: true
3+
carousel: true
4+
cfde_specific: true
5+
end_date: '2026-05-29T14:00:00-05:00'
6+
featured: false
7+
image: https://cfde-drc.s3.us-east-2.amazonaws.com/assets/img/webinar052926.png
8+
layout: '@/layouts/Outreach.astro'
9+
link: https://broadinstitute.zoom.us/webinar/register/WN_x0bGLLt4TbqFGlxlMM-T2A
10+
short_description: "New, Improved, Updated, FAIR-ified, and Integrated Datasets and Tools from Illuminating the Druggable Genome (IDG)"
11+
start_date: '2026-05-29T13:00:00-05:00'
12+
tags: '["webinar"]'
13+
title: CFDE Webinar Series
14+
dcc:
15+
- IDG
16+
17+
---
18+
New, Improved, Updated, FAIR-ified, and Integrated Datasets and Tools from Illuminating the Druggable Genome (IDG)

0 commit comments

Comments
 (0)