Enable to run Local network with a consensus node and mirror node #1

Neeharika-Sompalli · 2022-02-24T23:00:23Z

Closes hashgraph/hedera-services#2893

Combined the services and mirror node docker compose files to a single docker-compose.yml file
Created compose-network folder to have all static files needed to start Local node
Created network-logs folder to have all the logs generated from the run
Removed submodules

The following tests are run:

REST API queries for http://localhost:5551/api/v1/accounts?order=desc, http://localhost:5551/api/v1/transactions, http://localhost:5551/api/v1/balances?order=desc
MINIO UI shows the recordStreams and accountBalances at http://localhost:9001/buckets/hedera-streams/
GRPC tested with grpcurl -plaintext -d '{"file_id": {"fileNum": 102}, "limit": 0}' localhost:5600 com.hedera.mirror.api.proto.NetworkService/getNodes and streaming live messages when subscribed for topic
Web3 tested with newman run hedera-mirror-web3/postman.json --env-var baseUrl=http://localhost:8545 and all tests passed

Signed-off-by: Neeharika-Sompalli <[email protected]>

…stats csv file

README.md

compose-network/network-node/stdout.log

steven-sheehy · 2022-02-24T23:12:45Z

compose-network/mirror-node/application.yml

+      db:
+        host: 127.0.0.1
+        loadBalance: true
+        name: mirror_node
+        owner: ${hedera.mirror.importer.db.username}
+        ownerPassword: ${hedera.mirror.importer.db.password}
+        password: mirror_node_pass
+        port: 5432
+        restPassword: mirror_api_pass
+        restUsername: mirror_api
+        schema: public
+        username: mirror_node


This section can be removed as it is the application defaults.

Removed. Thanks

steven-sheehy · 2022-02-24T23:14:45Z

.gitignore

We should ignore log files generated anywhere.

Suggested change

network-logs/node/logs/*.log

network-logs/node/*.log

*.log

Agreed. Modified

steven-sheehy · 2022-02-24T23:18:37Z

.idea/hedera-network-e2e.iml

@@ -0,0 +1,12 @@
+<?xml version="1.0" encoding="UTF-8"?>


We shouldn't check in the .idea folder and add it to gitignore. Especially since this isn't a real project that needs anything more than a simple text editor.

Removed .idea folder

steven-sheehy · 2022-02-24T23:32:32Z

docker-compose.yml

+    mem_limit: 512m
+    memswap_limit: 512m
+    depends_on:
+      network-node:


Doesn't depend upon network-node. Should depend upon importer instead since he creates the schema.

Suggested change

network-node:

importer:

depend on network-node is intentionally added to make sure consensus node is started first , before any mirror node components, to resolve some error. Modified to depend on importer , will re-test multiple times to see if no issues occur.

steven-sheehy · 2022-02-24T23:33:30Z

docker-compose.yml

+    volumes:
+      - ./compose-network/mirror-node/application.yml:/usr/etc/hedera-mirror-web3/application.yml


This looks to be unneeded right now along with SPRING_CONFIG_ADDITIONAL_LOCATION.

Suggested change

volumes:

- ./compose-network/mirror-node/application.yml:/usr/etc/hedera-mirror-web3/application.yml

Got it ! Was added from mirror-node project. Removed.

steven-sheehy · 2022-02-24T23:39:11Z

docker-compose.yml

+    mem_limit: 512m
+    memswap_limit: 512m
+    depends_on:
+      network-node:


Suggested change

network-node:

importer:

As mentioned before modified. But will re-test multiple times

steven-sheehy · 2022-02-24T23:40:23Z

docker-compose.yml

+    mem_limit: 768m
+    memswap_limit: 768m
+    depends_on:
+      network-node:


Depends on minio, not node

Suggested change

network-node:

minio:

same here. Modified

steven-sheehy · 2022-02-24T23:42:42Z

docker-compose.yml

+      REST_PASSWORD: mirror_api_pass
+      ROSETTA_PASSWORD: mirror_rosetta_pass
+    networks:
+      - mirror-node-bridge


I'm not sure your intent for the mirror-node-bridge network, but right now it encompasses the uploaders, minio and all mirror node components. I think we should separate that more and have a mirror-node network that contains db, importer, grpc, rest and web3. Then importer only could also be on a network that is common with minio.

The two networks are added since network-node-potgres and db to not interfere with each other as both are on same port.
@steven-sheehy Do you mean to add third mirror-node network for clarity?

@Neeharika-Sompalli Steven is suggesting adding a third network (eg: uploader-bridge) that includes minio, the uploaders and the mirror node importer. The mirror node importer would wind up being a member of two networks so it could access the PostgreSQL database.

Therefore, the importer would have a network section that looks something like this:

networks: - mirror-node-bridge - uploader-bridge

What Nathan said, although disagree upon the naming:

networks: - mirror-node - cloud-storage

Fixed. Thanks @steven-sheehy @nathanklick

steven-sheehy · 2022-02-24T23:44:30Z

network-logs/minio-server/data/.minio.sys/format.json

@@ -0,0 +1 @@
+{"version":"1","format":"fs","id":"b43d434a-ae8b-4ed4-a7a6-0d80eda86ee8","fs":{"version":"2"}}


Why do we need to check in a logs or data folder? This seems like an anti-pattern and makes it easy to check in files we should not that might contain sensitive information. It should just be created by whichever component that needs it and gitignored.

The minio-server/data folder is added to create hedera-streams bucket when the server starts. When tried using mb to create bucket, faced few issues.
Do you think it should not be done this way ?

Agreed, will add this folder to gitignore

We should auto-create the bucket, but the network-logs folder doesn't need to be checked in to do this. I think minio will auto create buckets for any folder under /data. So you just need to modify the entrypoint/command to create the dir if it doesn't exist. There's a number of solutions here. Something like this:

entrypoint: sh command: -c 'mkdir -p /data/hedera-streams && /usr/bin/minio server /data'

Fixed as Steven suggested using the command
command: -c 'mkdir -p /data/hedera-streams && minio server /data --console-address ":9001"'

steven-sheehy · 2022-02-24T23:46:37Z

README.md

@@ -1,15 +1,18 @@
-# How to run a a mirror node with a local services code
+# How to run a LocalNode with a mirror node and consensus node


Suggested change

# How to run a LocalNode with a mirror node and consensus node

# How to run a local node with a mirror node and consensus node

Signed-off-by: Neeharika-Sompalli <[email protected]>

….log and stdout.log mounts

steven-sheehy

LGTM. Nice work!

compose-network/network-node/data/config/api-permission.properties

Neeharika-Sompalli and others added 30 commits February 18, 2022 08:25

initial commit for single docker-compose.yml

9a41a9e

update pointers

774c3b7

get latest changes

360e3a7

working changes for node

4f2bf4a

add .gitkeep

5fb19a8

add .gitkeep

b5c611b

update pointers

0bd6e3a

remove committing to logs

53fea2a

disable monitor

910d48b

change address book file

8d1f028

create bucket in minio at startup

81a7eaa

add uploaders .. but not working

8a08aa3

changes for syncing to minio bucket

49fb5b1

Updated minio config methodolgy

7bc8764

Update .env file

d276c38

working record stream uploader

85ebfaf

uploaders for eventstreams and accountbalances

a17ebde

Signed-off-by: Neeharika-Sompalli <[email protected]>

working uploaders

180cbca

fix extension for account balances

79f8259

remove rosetta, monitor as per review comments and add bind mount to …

7fae48f

…stats csv file

remove redis and use polling

4408d53

remove submodules and update README.md

3c547b9

remove event streams uploaders and set JAVA_HEAP_MAx to 2g

325e846

Update gitignore and remove old address book (not in use)

7e1cef8

Added forced mapping of the network-node IP

5a99ee6

Fix node IP address

95efcdb

Fix for broken YAML

4c46adb

Prevent network-node from using hedera user (UID: 2000)

e11043e

Disable event streams

cd4a852

Fix uploader

5f1e653

add README.md

c7ebe44

Neeharika-Sompalli requested review from beeradb, nathanklick, rbair23 and steven-sheehy February 24, 2022 23:02

nathanklick reviewed Feb 24, 2022

View reviewed changes

README.md Outdated Show resolved Hide resolved

Neeharika-Sompalli added 2 commits February 24, 2022 17:03

remove empty settings

99755da

remove explicit branch name

8e2bf7c

nathanklick reviewed Feb 24, 2022

View reviewed changes

compose-network/network-node/stdout.log Outdated Show resolved Hide resolved

Neeharika-Sompalli requested a review from tinker-michaelj February 24, 2022 23:10

Neeharika-Sompalli added 2 commits February 24, 2022 17:13

remove not needed log

7209ee4

keep only one address in addressBook.txt

b17a25d

Neeharika-Sompalli changed the title ~~Enable to run Local node with a consensus node and Mirror node~~ Enable to run Local network with a consensus node and mirror node Feb 24, 2022

steven-sheehy suggested changes Feb 24, 2022

View reviewed changes

Neeharika-Sompalli added 4 commits February 24, 2022 21:07

address a few review comments

5989b5e

delete .idea folder

ad7313c

Signed-off-by: Neeharika-Sompalli <[email protected]>

add minio-server/data/ to gitignore

787e158

split to separate networks

05c5769

Neeharika-Sompalli requested review from steven-sheehy and nathanklick March 2, 2022 16:12

Neeharika-Sompalli added 3 commits March 2, 2022 10:46

delete network-logs folder and create minio bucket runtime. Remove gc…

b6466c2

….log and stdout.log mounts

update README and add volume mount for minio data

72014b7

ignore all files in network-logs

ed1caae

steven-sheehy approved these changes Mar 2, 2022

View reviewed changes

beeradb reviewed Mar 2, 2022

View reviewed changes

compose-network/network-node/data/config/api-permission.properties Show resolved Hide resolved

beeradb approved these changes Mar 2, 2022

View reviewed changes

Neeharika-Sompalli changed the base branch from master to main March 2, 2022 20:31

Neeharika-Sompalli merged commit 6de4da6 into main Mar 2, 2022

Neeharika-Sompalli deleted the test-local-node branch March 2, 2022 20:33

david-bakin-sl mentioned this pull request May 18, 2023

Generating accounts no longer works as documented #339

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Enable to run Local network with a consensus node and mirror node #1

Enable to run Local network with a consensus node and mirror node #1

Neeharika-Sompalli commented Feb 24, 2022 •

edited

Loading

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 24, 2022 •

edited

Loading

Neeharika-Sompalli Feb 25, 2022

nathanklick Feb 25, 2022

steven-sheehy Feb 26, 2022

Neeharika-Sompalli Mar 2, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy Feb 26, 2022

Neeharika-Sompalli Mar 2, 2022

steven-sheehy Feb 24, 2022

Neeharika-Sompalli Feb 25, 2022

steven-sheehy left a comment

		volumes:
		- ./compose-network/mirror-node/application.yml:/usr/etc/hedera-mirror-web3/application.yml

		@@ -0,0 +1 @@
		{"version":"1","format":"fs","id":"b43d434a-ae8b-4ed4-a7a6-0d80eda86ee8","fs":{"version":"2"}}

		@@ -1,15 +1,18 @@
		# How to run a a mirror node with a local services code
		# How to run a LocalNode with a mirror node and consensus node

	# How to run a LocalNode with a mirror node and consensus node
	# How to run a local node with a mirror node and consensus node

Enable to run Local network with a consensus node and mirror node #1

Enable to run Local network with a consensus node and mirror node #1

Conversation

Neeharika-Sompalli commented Feb 24, 2022 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

steven-sheehy Feb 24, 2022 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

steven-sheehy left a comment

Choose a reason for hiding this comment

Neeharika-Sompalli commented Feb 24, 2022 •

edited

Loading

steven-sheehy Feb 24, 2022 •

edited

Loading