Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
235 commits
Select commit Hold shift + click to select a range
69fcd72
Merge pull request #36 from DeepDriveMD/develop
braceal Jul 6, 2021
a44d394
Merge pull request #47 from DeepDriveMD/develop
braceal May 17, 2022
1729bbd
Merge branch 'develop' of github.com:DeepDriveMD/DeepDriveMD-pipeline…
hjjvandam May 27, 2023
a0bb658
Adding initial NWChem code.
hjjvandam May 27, 2023
c5564cb
Various fixes.
hjjvandam Jun 18, 2023
bff689f
Getting ready to test
hjjvandam Jul 2, 2023
6da94f4
Mostly syntax fixes.
hjjvandam Jul 11, 2023
78555ca
DeepDriveMD has its own labels for machines.
hjjvandam Jul 11, 2023
3624c33
Now NWChem runs
hjjvandam Jul 16, 2023
5fdb0cf
Fixed DCD trajectory file name.
hjjvandam Jul 16, 2023
e20f3f9
Working around MDAnalysis's way of writing trajectory files
hjjvandam Jul 17, 2023
e3ed5ad
Adding reference PDB file.
hjjvandam Jul 17, 2023
1ccf00d
Tedious stuff
hjjvandam Jul 17, 2023
e0ddc7d
Turn HDF5 file locking off.
hjjvandam Jul 23, 2023
c3a0989
Adding reference PDB file needed for the Aggregate stage
hjjvandam Jul 26, 2023
d4134ed
Fixes for various problems with the NWChem implementation of the 1FME…
hjjvandam Oct 6, 2023
0cca51c
Found another bug in the NWChem XYZ file writer.
hjjvandam Oct 18, 2023
1713d5d
Large Model Extensions are only available with Anaconda Python
hjjvandam Oct 19, 2023
2cb23a5
Adding parallelism
hjjvandam Oct 20, 2023
73d31c8
Adding ligand binding test case
hjjvandam Oct 20, 2023
5da2556
Same structure as 7cz4_fixedFH_allH_nwc_small.pdb but atoms reordered
hjjvandam Oct 21, 2023
fbb82b1
Force parameters that are needed but unknown to NWChem
hjjvandam Oct 21, 2023
0b561be
Segment file needed for NWChem to interpret the APR residue correctly.
hjjvandam Oct 21, 2023
e8b69cd
Changes for the ligand binding use case.
hjjvandam Oct 30, 2023
e2b749f
Fix atoms selection
hjjvandam Oct 31, 2023
31d03c7
Comments on the analysis tools.
hjjvandam Nov 9, 2023
546ee01
Script to extract data for viz with Matplotlib.
hjjvandam Nov 30, 2023
ae06159
Fixes to help text.
hjjvandam Nov 30, 2023
d8dcc3a
Adding explaination of output.
hjjvandam Dec 1, 2023
bb3a2eb
Adding wait until something is pressed.
hjjvandam Dec 2, 2023
62b72f9
Adding more color and wait for keypress to exit
hjjvandam Dec 4, 2023
99f120d
Adding performance plotting script.
hjjvandam Dec 5, 2023
ac660a3
Small Python fixes.
hjjvandam Dec 12, 2023
1d10c03
Adding legend
hjjvandam Dec 12, 2023
0e30d24
Adding image saving capability.
hjjvandam Dec 12, 2023
8978eee
Basic scripts to generate plots
hjjvandam Dec 12, 2023
77ee834
Utility scripts to collect or remove prior artifacts
hjjvandam Dec 13, 2023
155411a
Adding a structure for the ab-initio use case
hjjvandam Dec 15, 2023
8d7e590
Merge branch 'feature/nwchem' of github.com:hjjvandam/DeepDriveMD-pip…
hjjvandam Dec 15, 2023
5cc9b14
Ab-initio + DeePMD use case
hjjvandam Dec 20, 2023
95654d8
Updating comments
hjjvandam Dec 20, 2023
c094ec8
Updates for larger runs.
hjjvandam Dec 21, 2023
2608be1
Remove adft to enable convergence
hjjvandam Dec 22, 2023
19eb7ec
Suppress excessive output and add iterations for convergence
hjjvandam Dec 22, 2023
b8171d0
Delete trajectory files when they're no longer needed
hjjvandam Dec 27, 2023
f8ef8ec
Fixing some layout issues
hjjvandam Dec 27, 2023
6200793
Adding ab-initio calcs.
hjjvandam Mar 28, 2024
731840c
Adding simulation box
hjjvandam Mar 29, 2024
c174c3f
Adding formaldehyde structures.
hjjvandam Mar 29, 2024
fd6ba04
Force add this file.
hjjvandam Mar 29, 2024
f89bbf3
Adding some docs.
hjjvandam Mar 29, 2024
c466c4d
Hmmm, GitHub markdown does not seem to know proper citations.
hjjvandam Mar 29, 2024
a8e40e8
Adding ability to generate an initial set of structures to seed the FF.
hjjvandam Apr 5, 2024
f66934c
Compress the (atom) type list
hjjvandam Apr 7, 2024
b153dbc
Adding training code.
hjjvandam Apr 7, 2024
d7a1f12
Adding training
hjjvandam Apr 7, 2024
de974dc
The json thing is not needed here
hjjvandam Apr 7, 2024
e5edc0f
Update comments in accordance to https://peps.python.org/pep-0257/
hjjvandam Apr 7, 2024
0a53880
Start integrating LAMMPS
hjjvandam Apr 8, 2024
6505788
Move molecule because of ASE peculiarities
hjjvandam Apr 8, 2024
d493fc5
Save current implementation, will change fundamentally.
hjjvandam Apr 10, 2024
23a33c0
First working set of components for ab-initio deepdrivemd.
hjjvandam Apr 11, 2024
a021d56
Removed some commented out code.
hjjvandam Apr 11, 2024
6c69c18
Fixed the generation of the HDF5 contactmap file.
hjjvandam Apr 12, 2024
1d289cf
Adding a number of specific training data points.
hjjvandam Apr 13, 2024
0472d00
Adding the ability to include particular input files in the training …
hjjvandam Apr 13, 2024
de27c3b
A few more basic training data points
hjjvandam Apr 13, 2024
600ad74
These two case need more iterations
hjjvandam Apr 13, 2024
59000ef
Adding code for doing the next iteration in the DeePMD optimization
hjjvandam Apr 15, 2024
fb9f42b
Adding structures to teach energies at short bond lengths
hjjvandam Apr 15, 2024
a298a95
Adding error handling in case NWChem did not converge
hjjvandam Apr 15, 2024
3b115d4
Handle the case where the models are being retrained.
hjjvandam Apr 15, 2024
a18e6ab
Adding RP script and modified deepmd, lampps and nwchem tasks
okilic1 Apr 18, 2024
f2121c1
Adding configuration for LAMMPS.
hjjvandam Apr 18, 2024
17d393f
Adding more input files.
hjjvandam Apr 18, 2024
d98a2d9
The version of PyYAML was changed
hjjvandam Apr 18, 2024
296a389
Hyperparameters for finer grained nets and more init training data
hjjvandam Apr 18, 2024
d799050
Comments on the contents of this directory.
hjjvandam Apr 19, 2024
65d1202
Adding comments on new workflow.
hjjvandam Apr 19, 2024
9900632
Adding clarification.
hjjvandam Apr 19, 2024
dceb957
Adding sync execution script
okilic1 Apr 19, 2024
fd9ba5d
clean up
okilic1 Apr 19, 2024
ea80328
Original YAML file copied from molecular_dynamics_workflow_nwchem_test
hjjvandam Apr 19, 2024
21a8625
Initial LAMMPS setup
hjjvandam Apr 19, 2024
df53b2e
For LAMMPS-DeePMD we need the location of the models.
hjjvandam Apr 19, 2024
5e940d1
Suppress code for txt LAMMPS trajectories.
hjjvandam Apr 19, 2024
b82acce
Adding run_lammps script to drive LAMMPS simulations.
hjjvandam Apr 19, 2024
a3a3fb2
Initial script to test drive run_lammps.py
hjjvandam Apr 19, 2024
5ebfc69
Changes to try to get this to work
hjjvandam Apr 20, 2024
49de777
Adding Mulliken analysis
hjjvandam Apr 20, 2024
7f6f3a5
Extending the initial random walk
hjjvandam Apr 20, 2024
aff7889
Make rattle random
hjjvandam Apr 21, 2024
1609da0
Do something sensible if NWChem refused to run the calculation
hjjvandam Apr 21, 2024
df59ce7
Adding mostly modified sync execututable. I am still working on it to…
okilic1 Apr 23, 2024
754b466
some TODOs
okilic1 Apr 23, 2024
84db273
address my FIXMEs
andre-merzky Apr 23, 2024
3f4b390
I think sync version is ready for testing
okilic1 Apr 24, 2024
e300cf8
fixing the task uid
okilic1 Apr 24, 2024
4d18964
adress TODOs
andre-merzky Apr 24, 2024
b0a56d1
Adding aggregation task
okilic1 Apr 24, 2024
5ef6a84
Pretrained models to run the DeepDriveMD loop without the ab-initio loop
hjjvandam Apr 22, 2024
b90643f
Fixing import confusion
hjjvandam Apr 24, 2024
6ef8faf
Minor adjustments
hjjvandam Apr 24, 2024
7fe272e
Fine tuning for BNL's IC-gen2 cluster
hjjvandam Apr 24, 2024
3687a0f
Changed lammps_run to run_lammps
hjjvandam Apr 24, 2024
fa42c22
Importing ase_lammps instead of complicated path
hjjvandam Apr 24, 2024
693546f
Hacked _control_md
hjjvandam Apr 24, 2024
d8cd2db
Updates for different iterations
hjjvandam Apr 25, 2024
ffc227d
Store results
hjjvandam Apr 25, 2024
36a4d0b
Making progress on LAMMPS and DFT1
hjjvandam Apr 25, 2024
5fb8151
Adding selection of input file
okilic1 Apr 25, 2024
9224718
Add only the latest DFT results to training data
hjjvandam Apr 25, 2024
9245283
Fixing many typos later...
hjjvandam Apr 25, 2024
7c9ca13
Works now.
hjjvandam Apr 25, 2024
526435e
Adding command line arguments
hjjvandam Apr 25, 2024
06adf5c
Adding command line arguments
hjjvandam Apr 25, 2024
7c59c6b
Working out command line arguments for the task submits
hjjvandam Apr 25, 2024
8844b84
Adding output for checking progress
hjjvandam Apr 26, 2024
84830c8
Interesting bugs that hang the Python interpreter...
hjjvandam Apr 26, 2024
2d10397
Add import sys
hjjvandam Apr 26, 2024
b8e4f02
Simple fixes.
hjjvandam Apr 26, 2024
f8dbcc4
Fixing arguments
hjjvandam Apr 26, 2024
2c0faae
Fixes for training.
hjjvandam Apr 26, 2024
dc25d6d
Scratch directories are now relative paths and add Mulliken analysis
hjjvandam Apr 26, 2024
3476b8f
Update directory paths
hjjvandam Apr 26, 2024
f6e68f2
Use smaller basis set for speed
hjjvandam Apr 26, 2024
0f76bc7
Ab-initio loop working now
hjjvandam Apr 29, 2024
25d7462
Up the number of initial training points.
hjjvandam Apr 29, 2024
59dbb8f
Addding adaptive execution based on sync script
okilic1 Apr 29, 2024
f005067
Pick first structure from PDB file.
hjjvandam Apr 30, 2024
1f99bb9
Clean the PDB file coming from LAMMPS
hjjvandam Apr 30, 2024
747a4aa
Change the DFT solver
hjjvandam May 2, 2024
653751f
Adding minimization and fix list of PDB files
hjjvandam May 2, 2024
586ef47
Shortening the training phases for workflow evaluation
hjjvandam May 2, 2024
9d8268f
Extent time limit and force switching between loops
hjjvandam May 2, 2024
1ad275a
Make systems closed shell
hjjvandam May 2, 2024
fe116a0
Switch to restricted open-shell
hjjvandam May 2, 2024
21a4a10
Switch to closed shell semi-Newton-Raphson
hjjvandam May 2, 2024
6a15a0b
Switch to restricted open shell
hjjvandam May 2, 2024
9be0edf
Switch to closed shell.
hjjvandam May 2, 2024
a57d8ce
Increase the time limit to 6 hours.
hjjvandam May 2, 2024
3d9ee50
Updating the geometries for the DDMD LAMMPS calculations
hjjvandam May 5, 2024
3420e84
Adding missing PyTorch conv1d hyper-parameters
hjjvandam May 9, 2024
43274db
Switching to a bigger molecule
hjjvandam May 10, 2024
4ba0517
Multiple fixes
hjjvandam May 10, 2024
2d31a5e
Keras currently does not work due to API changes
hjjvandam May 10, 2024
223d20c
Handle case when a directory does not contain any matching files
hjjvandam May 10, 2024
60cf60f
Adapt workflow configuration to all code fixes
hjjvandam May 10, 2024
25cd588
Adjust the atoms selections
hjjvandam May 10, 2024
f660791
Adapt interfaces to run LAMMPS from ab-initio or DDMD loop
hjjvandam May 10, 2024
817c7db
Do big calculations first - small calculations last
hjjvandam May 10, 2024
3c75824
Adding a slew of missing dependencies.
hjjvandam May 10, 2024
161c26d
Harmonizing scripts.
hjjvandam May 20, 2024
59fb505
Update NWchem_T1.py
okilic1 May 21, 2024
8483310
Copy agent sandbox to client sandbox automatically
hjjvandam May 23, 2024
215513e
Check NWChem success per calculation
hjjvandam May 28, 2024
3f216b0
Fix switching between phases.
hjjvandam May 28, 2024
d1ee090
Put the pilot sandbox in the experiment directory
hjjvandam May 28, 2024
0b7153b
Make the LAMMPS piece a Python module
hjjvandam Jun 24, 2024
b791f36
Use a regular Python virtual environment
hjjvandam Jun 24, 2024
d85eab0
Update to newer version of Pydantic
hjjvandam Jun 24, 2024
c12baaf
Updating to newer version of Pydantic
hjjvandam Jun 24, 2024
21b972a
Pydantic now requires that optional fields have a default value
hjjvandam Jun 24, 2024
5c9b469
Updating to new version of Pydantic
hjjvandam Jun 24, 2024
cca54b4
Updating to newer version of Pydantic
hjjvandam Jun 24, 2024
ccb4446
Syntax fixes
hjjvandam Jun 24, 2024
25e9405
Adding the feature to clean up any straggling DFT calculations
hjjvandam Jun 28, 2024
33ba36c
Recording GPU usage.
hjjvandam Jun 28, 2024
3b1e363
Modified the logic switching from DeePMD to DeepDriveMD loop
hjjvandam Jun 28, 2024
62b0b49
Adding new experiments.
hjjvandam Jun 28, 2024
6be0b27
Sharing version with print statements.
hjjvandam Jul 1, 2024
2f85481
Adding an option for generate task description where it doesn't call …
okilic1 Jul 1, 2024
77f2b55
Tightening the lower criterion
hjjvandam Jul 2, 2024
3533a21
Fixed wrong variable names
hjjvandam Jul 2, 2024
34a99e5
Setting the number of GPUs to something sensible
hjjvandam Jul 2, 2024
0c4ef9b
If we get an I/O-error on an output file just skip it
hjjvandam Jul 3, 2024
f75c9b7
Wait for tasks to terminate when canceled before starting new tasks
hjjvandam Jul 3, 2024
52e42cd
Probabilistically bring MD back to sanity
hjjvandam Jul 5, 2024
e80c871
Fix a very unlikely race condition
hjjvandam Jul 5, 2024
a0b5e8d
Fix path.
hjjvandam Jul 5, 2024
ef70816
Add missing copy package for copy.deepcopy.
hjjvandam Jul 7, 2024
b66f537
Fixing progress display, show only # cores columns
hjjvandam Jul 9, 2024
4193b5e
DeGPUize the pytorch training
hjjvandam Jul 9, 2024
2c4367b
Reduce the initial number of structures to 120 from 480
hjjvandam Jul 10, 2024
6ce2a21
Add function back model_devi.out up
hjjvandam Jul 10, 2024
c9c3224
Tighter lower cutoff + back up model_devi.out
hjjvandam Jul 10, 2024
0c5ca78
Pytorch runs out of memory on backward autograd pass on GPUs
hjjvandam Jul 12, 2024
89dea84
Removing debug prints
hjjvandam Jul 12, 2024
874c08b
Print something whether we continue or restart the MD
hjjvandam Jul 12, 2024
a01afc0
Keep lcurve.out for diagnostics.
hjjvandam Jul 12, 2024
c2eaa15
Update call to lammps_input
hjjvandam Jul 30, 2024
2c38d72
Fix string from Path
hjjvandam Jul 30, 2024
70025b2
Script to convert DeePMD training data to N2P2 format.
hjjvandam Aug 20, 2024
a2faf7e
N2P2 tool for symmetry function generation
hjjvandam Aug 22, 2024
03dd7e7
Fixed the molecule output format
hjjvandam Aug 27, 2024
927b47f
Putting all training data in a single file
hjjvandam Aug 27, 2024
c302cc2
Adding list of elements to comment line
hjjvandam Aug 28, 2024
ffb083f
Adding training code
hjjvandam Aug 29, 2024
1d462a0
Apparently the cutoff is the minimal cutoff which should be 0 <= cuto…
hjjvandam Aug 29, 2024
5e730cc
N2P2 insists on IUPAC consistent capitalization
hjjvandam Aug 29, 2024
648d1e6
Minor fix
hjjvandam Aug 29, 2024
a95f723
Adding my own rattle function using a uniform distribution
hjjvandam Aug 30, 2024
1e8a8f8
Use N2P2 now
hjjvandam Aug 30, 2024
17a9fcd
Only run the data transformation when explicitly called or if this is…
hjjvandam Aug 30, 2024
ae861b1
Use N2P2 now
hjjvandam Aug 30, 2024
b18b6e3
Adding hydrogen peroxide
hjjvandam Aug 30, 2024
576d2d2
New inputs
hjjvandam Aug 30, 2024
37df002
N2P2 needs data on a c-c-c angle term
hjjvandam Aug 31, 2024
b780714
N2P2 cannot deal with individual atoms
hjjvandam Sep 1, 2024
6273289
Add N2P2 model training
hjjvandam Sep 3, 2024
a0e783d
For N2P2 it looks as if the training set needs to be much larger
hjjvandam Sep 6, 2024
fa6286a
Switching to N2P2
hjjvandam Sep 6, 2024
0c31813
Partially switched to N2P2
hjjvandam Sep 6, 2024
8459b39
Adding code for dealing with data stored in "input.data" files
hjjvandam Sep 6, 2024
de6e71e
Adding more structures
hjjvandam Sep 10, 2024
8c8589b
C3 with only single bonds
hjjvandam Sep 10, 2024
7b518b6
Removing geometries with CC double bonds
hjjvandam Sep 10, 2024
5d679a1
reintroducing single atom calculation for DeePMD
hjjvandam Sep 13, 2024
86707ee
Make model switchable between DEEPMD and N2P2
hjjvandam Sep 13, 2024
e120c50
Minor fix.
hjjvandam Sep 13, 2024
8288f5e
Make model switchable.
hjjvandam Sep 13, 2024
2d52797
Minor change
hjjvandam Sep 13, 2024
a846b13
Fix syntax
hjjvandam Sep 13, 2024
e9cc050
Fix syntax
hjjvandam Sep 13, 2024
4d9d20c
DeePMD/N2P2 fixes
hjjvandam Sep 16, 2024
c33b5d6
Stuff for comparing results from N2P2 models
hjjvandam Sep 16, 2024
0e0e63d
Re-adding some fixes?
hjjvandam Sep 17, 2024
1a68cda
Adding filtering of symmetry functions based on atom counts
hjjvandam Sep 17, 2024
50277e3
Bring N2P2 implementation inline with DeePMD
hjjvandam Sep 17, 2024
72c6e8a
Automatically switch between DEEPMD and N2P2
hjjvandam Sep 17, 2024
98e77c8
More fixes for DeePMD/N2P2.
hjjvandam Oct 8, 2024
877d7b2
Correct paths for generative model_devi.out
hjjvandam Oct 14, 2024
3765e66
Adding switch between DEEPMD and N2P2.
hjjvandam Oct 14, 2024
ab199a4
Adapt to DEEPMD and N2P2 capabilities
hjjvandam Oct 14, 2024
458f51b
Minor fix
hjjvandam Dec 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 17 additions & 1 deletion bin/run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,22 @@ which radical-stack
hostname

radical-stack

# HDF5 often fails to lock files on compute nodes
# so best turn locking off to prevent failures
# in the reporter.
#
# The error message in question is:
# "Unable to create file (unable to lock file, errno = 524, error message = 'Unknown error 524')"
#
# More information on this error:
# https://github.com/nanoporetech/medaka/issues/240
#
# See for the reporter h5py code:
# - MD-tools/mdtools/openmm/reporter.py
# - MD-tools/mdtools/nwchem/reporter.py
export HDF5_USE_FILE_LOCKING="FALSE"

python -m deepdrivemd.deepdrivemd_stream -c bba/$1/config.yaml
#python -m deepdrivemd.deepdrivemd_stream -c bba/$1/config.yaml
python -m deepdrivemd.deepdrivemd -c $1/config.yaml

2,657 changes: 2,657 additions & 0 deletions data/7cz4/7CZ4-folded.pdb

Large diffs are not rendered by default.

19 changes: 19 additions & 0 deletions data/7cz4/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# 7CZ4 - NSP3 macro domain with bound ligand

The structures stored in this directory relate to the ligand binding use case.
The original structure was obtained from the protein databank ID
[7CZ4](https://www.rcsb.org/structure/7cz4).
The initial structure was incomplete missing some heavy atoms as well
as Hydrogens. This structure was "fixed" with
[Moprobity](http://molprobity.biochem.duke.edu/) and
[PDBFixer](https://github.com/openmm/pdbfixer).
Finally, only the monomer of the protein was kept. The resulting structure
is stored in `7CZ4-folded.pdb`. This name is analogous to the way systems
are named in the `bba` directory.
More details on how this structure was prepared can be found at
<https://github.com/hjjvandam/nwchem-1/tree/pretauadio2/QA/tests/7cz4>.

The structure in `system/7CZ4-unfolded.pdb` was created by first shifting
the ligand out of the protein, and subsequently running dynamics on it at
310K. Conventional dynamics was not able to have the ligand find its binding
location.
2,651 changes: 2,651 additions & 0 deletions data/7cz4/system/7CZ4-unfolded.pdb

Large diffs are not rendered by default.

Loading