DogFooding by zhang lei

[zhanglei1949]

> uname -a 
Linux iZj6c08xfouy25e3foppgsZ 5.15.0-71-generic #78-Ubuntu SMP Tue Apr 18 09:00:29 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

> python --version
Python 3.10.6

Task 1: 在本地试用 GraphScope

• 安装 GraphScope
• 载入 ogbn_mag 内置图
• Project ogbn_mag到一个简单图，选择点标签为 paper, 边标签为 cites, 属性都为空。
• 在简单图上运行一个 Kcore 算法, 并打印结果为 pandas.DataFrame
• 在 ogbn_mag图上启动交互引擎 （Interactive）
• 通过 gremlin 计算图有多少点，边
• 对于 ogbn_mag图，使用 learning 定义并执行一个 GCN 训练过程，可参考 CI 或文档中定义的过程
• 退出 GraphScope。

Task 2: 在本地开发调试 GraphScope

• 通过 vineyardd直接启动 vineyard
• 从源代码编译 Analytical Engine，找到编译出的binary grape_engine， 通过 grape_engine直接运行 analytical_engine，然后退出 grape_engine 进程
• 为 GAE 添加一条日志 ( analytical_engine/core/server/analytical_server.cc)，并重新编译，启动并找到新添加的日志
• 从源代码编译 Interactive Engine，找到编译出的 frontend-x-SNAPSHOT.jar和 gaia_executor,直接运行这个 jar 包和这个 gaia_executor，使 frontend 能够连接到 executor。
• 了解 Frontend 和 Executor 的代码位置和组织结构，为 GIE 的 Frontend (interactive_engine/frontend/src/main/java/com/alibaba/graphscope/frontend/Frontend.java) 和 executor (interactive_engine/executor/assembly/v6d/src/bin/gaia_executor.rs) 各添加一条日志，并重新编译，启动并找到新添加的日志
• 从源代码编译 Learning Engine, 找到 libgraphlearn_shared.so
• 使用 setup.py 安装 coordinator 和 client。 注意因依赖关系， client 安装要在 coordinator 之前
• 继续安装 GAE，GIE，和 GLE 到预设安装目录。（上一步只有编译。相当于 make 和 make install 的区别）
• 找到 Client， Coordinator， GAE，GIE 和 GLE 的安装位置目录
• 若一切正常，这时你能通过 python 拉起 graphscope。启动python，import graphscope 并载入一个内置 modern_graph 图，在图上启动图交互引擎，发送一个查所有点的语句。
• 退出 graphscope

[zhanglei1949]

Install tensorflow < 2.0

[zhanglei1949]

Check giectl for how to run frontend and gaia_executor

[zhanglei1949]

https://graphscope.io/docs/latest/interactive_engine/dev_and_test

[zhanglei1949]

Successfully built graphscope-client
Installing collected packages: protobuf, grpcio, grpcio-tools, graphscope-client
  Attempting uninstall: graphscope-client
    Found existing installation: graphscope-client 0.22.0
    Uninstalling graphscope-client-0.22.0:
      Successfully uninstalled graphscope-client-0.22.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gs-coordinator 0.21.0 requires grpcio<=1.43.0,>=1.40.0; python_version < "3.11", but you have grpcio 1.54.2 which is incompatible.
gs-coordinator 0.21.0 requires grpcio-tools<=1.43.0,>=1.40.0; python_version < "3.11", but you have grpcio-tools 1.54.2 which is incompatible.
gs-coordinator 0.21.0 requires protobuf<=3.18.1,>=3.15.0; python_version < "3.11", but you have protobuf 4.23.2 which is incompatible.
Successfully installed graphscope-client-0.22.0 grpcio-1.54.2 grpcio-tools-1.54.2 protobuf-4.23.2

[zhanglei1949]

giectl

[zhanglei1949]

ERROR: Could not find a version that satisfies the requirement graphscope_client==0.22.0 (from gs-coordinator) (from versions: 0.19.0, 0.20.0, 0.21.0, 0.22.0a20230514, 0.22.0a20230515, 0.22.0a20230516, 0.22.0a20230523, 0.22.0a20230524, 0.22.0a20230525, 0.22.0a20230526, 0.22.0a20230527, 0.22.0a20230528, 0.22.0a20230529, 0.22.0a20230530, 0.22.0a20230531, 0.22.0a20230601)
ERROR: No matching distribution found for graphscope_client==0.22.0

[zhanglei1949]

Building wheels for collected packages: graphscope-client
Building editable for graphscope-client (pyproject.toml) ... done
Created wheel for graphscope-client: filename=graphscope_client-0.0.0-0.editable-cp310-cp310-linux_x86_64.whl size=10970 sha256=fdf2074e4bf4c239d2602675308a0bde48a62c08eaafee9b5ca6b18b0188b889
Stored in directory: /tmp/pip-ephem-wheel-cache-t9gp752j/wheels/32/cb/11/007bf171c57153d6c8f7d7186904634a20bf9984a50aa19243
Successfully built graphscope-client
Installing collected packages: graphscope-client
Successfully installed graphscope-client-0.0.0

[zhanglei1949]

33e3007