230 Commits

Author SHA1 Message Date
Wenxuan Cao 17017c2899 [distGB] graphbolt graph edge's mask will be filled with 0 if these edges have no mask initial (#7846) 2025-01-09 19:52:10 +08:00
Andrei Ivanov 540dd2ba4d [TestFailure] Resolving exceptions thrown across multiple GraphBolt tests. (#7852) 2025-01-08 14:05:34 +08:00
Wenxuan Cao d92c98d927 [distGB] change test_mp_dataloader (#7819)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-52-174.us-west-2.compute.internal>
2024-10-16 12:52:59 +08:00
Wenxuan Cao adbefc6c77 [DistGB]Restore the gb_convert_single_dgl_partition of the public function in partition.py (#7803)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-8-126.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-52-174.us-west-2.compute.internal>
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2024-09-25 10:40:07 +08:00
Wenxuan Cao 3bc8e228fc [DistGB] enable dist partition pipeline to save FusedCSCSamplingGraph partition directly (#7728)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-8-126.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-52-174.us-west-2.compute.internal>
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2024-09-19 17:05:11 +08:00
Wenxuan Cao 165e2507e7 [DistGB] modify partition.py to save FusedCSCSamplingGraph directly (#7727)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-8-126.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-52-174.us-west-2.compute.internal>
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2024-09-12 16:55:33 +08:00
Rhett Ying bf125d8015 [Dist] fix node/edge map for few nodes/edges (#7785) 2024-09-10 08:10:39 +08:00
Rhett Ying 8772c02db7 [DistGB] fix prob attr not exist (#7783) 2024-09-06 13:56:20 +08:00
Rhett Ying 12841c675b [Dist] backward compatible with dgl.dataloading.DistDataLoader (#7782) 2024-09-06 11:21:52 +08:00
Wenxuan Cao 0734e33e0e [DistGB] save as graphbolt graph directly after partition test case (#7724)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-8-126.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-52-174.us-west-2.compute.internal>
2024-09-05 14:08:28 +08:00
Rhett Ying 9782c021de [Dist] move DistNode/EdgeDataLoader to distributed (#7755) 2024-08-29 16:10:05 +08:00
Rhett Ying eddbfca53e [DistGB] fix return_eids argument (#7754) 2024-08-29 09:30:32 +08:00
Theodore Vasiloudis ceb6672e63 [GraphBolt] Allow using multiple processes for GraphBolt partition conversion (#7497) 2024-07-30 13:28:29 +08:00
Rhett Ying ed50c170dd [DistGB] fix add edge attr request (#7460) 2024-06-14 13:29:56 +08:00
Rhett Ying 7f1d164392 [DistGB]enable prob/mask sampling on graphbolt partitions (#7458) 2024-06-13 17:25:22 +08:00
Rhett Ying c29a2d01bc [DistGB] store original homo eids in default for GB partitions (#7455) 2024-06-12 11:22:00 +08:00
Rhett Ying 0fee9be329 [DistGB] exclude edges right after sampling (#7442) 2024-06-03 10:16:44 +08:00
Rhett Ying 470769c877 [DistGB] enable find_edges() for GraphBolt partitions (#7416) 2024-05-27 14:18:29 +08:00
Rhett Ying d2a2bf0f8d [DistDGL] enable exclude_edges for sample_etype_neighbors() (#7427) 2024-05-24 13:42:46 +08:00
Rhett Ying 9dcdace519 [DistDGL] enable exclude edges sample_neighbors() (#7425) 2024-05-23 11:51:38 +08:00
Rhett Ying 191681d851 [DistDGL] fix device mismatch when calling all_to_all with gloo backend (#7409) 2024-05-17 08:08:24 +08:00
Muhammed Fatih BALIN d3483fe1f1 [GraphBolt][CUDA] Optimize hetero sampling. (#7223) 2024-04-03 03:18:30 -04:00
Rhett Ying 8ab27b0581 [DistGB] enable replacement sampling with GraphBolt API (#7202) 2024-03-08 14:02:48 +08:00
Rhett Ying a6505e86a4 [DistGB] revert toindex() but refine tests (#7197) 2024-03-06 09:56:40 +08:00
Rhett Ying 494d4cd73f [DistGB] enable graphbolt for homograph distDGL (#7182) 2024-03-01 15:03:47 +08:00
Rhett Ying d8d87243c8 [DistGB] restrict NID/EID as int64_t (#7177) 2024-02-29 16:03:34 +08:00
Rhett Ying ebf505ee92 [DistGB] update top level API about use_graphbolt (#7169) 2024-02-28 15:20:37 +08:00
Rhett Ying d1bea9e87f [DistGB] format dtype when converting partition to GraphBolt format (#7150) 2024-02-28 09:24:39 +08:00
Rhett Ying 045beeba14 [DistGB] remove toindex() as torch tensor is always be expected (#7146) 2024-02-26 14:04:35 +08:00
Rhett Ying 63541c88f1 [DistGB] enable int32 id ranges in IdMap (#7144) 2024-02-26 10:28:59 +08:00
Rhett Ying b0080d5bac [DistGB] add graphbolt flag into top level API (#7122) 2024-02-22 09:26:45 +08:00
Rhett Ying 8e6cbd621f [DistGB] sample with graphbolt on heterograph via DistNodeDataLoader (#7112) 2024-02-09 15:51:39 +08:00
Rhett Ying 6735a3ae3d [DistGB] enable sample etype neighbors on heterograph (#7095) 2024-02-09 10:09:16 +08:00
Rhett Ying 3ebdee7768 [DistGB] sample with graphbolt on homograph via DistNodeDataLoader (#7108) 2024-02-09 09:58:32 +08:00
Rhett Ying 0504bc2c11 [DistGB] use expand_indptr for csc to coo (#7090) 2024-02-07 10:08:56 +08:00
Rhett Ying ee8b7b39ce [DistGB] enable GB sampling on heterograph (#7087) 2024-02-06 11:22:38 +08:00
Rhett Ying 4ee0a8bddb [DistGB] return global eids from GB sampling on homograph (#7085) 2024-02-05 13:22:44 +08:00
Rhett Ying f3af2a9fd4 [DistGB] return eids together with etype_ids in sampling (#7084) 2024-02-05 09:48:20 +08:00
Rhett Ying 6459a688ae [DistGB] enable GB sampling on homograph (#7061) 2024-02-04 10:39:44 +08:00
Rhett Ying 571340dac6 [DistGB] update partition_graph to support graphbolt (#7053) 2024-02-01 11:37:43 +08:00
Rhett Ying df6b3250f4 [DistGB] enable DistGraph to load graphbolt partitions (#7048) 2024-02-01 09:39:50 +08:00
Rhett Ying af870387fc [DistGB] add verify logic for GraphBolt partitions (#7031) 2024-01-30 16:30:00 +08:00
Rhett Ying 683772514e [DistGB] enable DistGraphServer to load graphbolt partitions (#7042) 2024-01-30 11:21:16 +08:00
Rhett Ying 366fb02fbd [DistGB] enable to load GB partitions (#7029) 2024-01-26 12:38:25 +08:00
Rhett Ying 0bfe34d96b [DistGB] refine convertion from dgl to graphbolt (#7007) 2024-01-25 14:55:25 +08:00
Rhett Ying e9d5156e3c [GraphBolt] rename from_fused_csc as fused_csc_sampling_graph (#6732) 2023-12-12 16:19:41 +08:00
Rhett Ying 1a8e0c00a9 [GraphBolt] remove GraphMeta and update API accordingly (#6709) 2023-12-12 14:49:50 +08:00
Rhett Ying c213444268 [GraphBolt] use torch.load/save instead of load/save_fused_xxx() (#6707) 2023-12-07 17:17:31 +08:00
Rhett Ying 3cdc37ccd7 [GraphBolt] add ntype/etype_to_id into graph and save/load() (#6687) 2023-12-05 15:56:10 +08:00
LastWhisper 91fe0c9069 [GraphBolt] Refactor CSCSamplingGraph and update the corresponding method. (#6515) 2023-11-04 03:09:14 +08:00