Grafana Dashboard now working... very quick

Working on a home project? Post it here.
networkingdude
Posts: 4
Joined: Wed Sep 27, 2017 12:12 am

Re: Grafana Dashboard now working... very quick

Post by networkingdude » Mon Nov 27, 2017 10:09 am

Is there a way to add channels together in graphana? I have my 220a CT's on separate channels.
ben
Site Admin
Posts: 4254
Joined: Fri Jun 04, 2010 9:39 am

Re: Grafana Dashboard now working... very quick

Post by ben » Mon Nov 27, 2017 10:39 am

networkingdude wrote:Is there a way to add channels together in graphana? I have my 220a CT's on separate channels.
The Grafana version is several months old now so there may be more improvements.

You should be able to do something like:

SELECT A + B FROM "influx" to give you a combined total of the 2 columns.
Ben
Brultech Research Inc.
E: ben(at)brultech.com
smilligan
Posts: 20
Joined: Tue Feb 14, 2012 8:48 am

Re: Grafana Dashboard now working... very quick

Post by smilligan » Fri Mar 09, 2018 9:58 pm

Ben,

1) I concur with previous poster's comments that you must install the python influxdb client using "pip install influxdb". I installed python 2.7 ONLY so not sure if one must use pip or pip2 to do the install.
2) For future readers, you may want to clarify about the "influxdb_database = xxxx " in btmon.cfg. Specifically that this is the name that is assigned the influxDB index if one does not already exist. This does NOT need to correspond to anything in the influxdb.conf file. So this is the name that will be used to build the influxDB instance if it does not already exist. Furhtermore, once you define this DB in the btmon.cfg file, you will also need to use this same db instance name in the grefana admin/cfg settings to let it know the DB instance of the influxdb server.

also, I got the following error:

[Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond

I had assumed this is related to the comms between python script and GEM. the btmon.cfg that we downloaded from you zip showed a port of 8000.. we had incorrectly assumed that this was a special port used for serving up the Bin-48-NET-Time packets. After a few hours of scratching our heads we changed the port in btmon.cfg to use the same port that we go in on for the web admin of GEM. (80).

Hope the above helps others that work with Ben's ZIP to try the grafana/influxdb combo..

I must admit it is light weight and does not require a lot of bandwidth. (We currently use DASH 2.0 and have been pleased with it, but the grafana UI may allow us better aggregation of circuits that feed subpanels and so on..

Ben: thanks for your help in this.

Sean
smilligan
Posts: 20
Joined: Tue Feb 14, 2012 8:48 am

Re: Grafana Dashboard now working... very quick

Post by smilligan » Sun Mar 11, 2018 9:12 am

Ok, I am going to show "how lazy" I am here..

I have grafana/influxdb/btmon working and collecting data on th WIN10 host using the components (versions) from Ben's zip

I started looking at the Select statements in the Garfana query creation.. It seems to generally adhere to SQL, but do not have enough SQL expertise to say where/if it deviates/forks from standard SQL.

Point being: I am lazy and do not want to spend the time to learn Garfana/influxDB to evaluate the "user experience" as a DASH replacement. So I was wondering if someone had some GEM dashboards they could provide that I could use as a basis/example?

Thanks
mminehan
Posts: 33
Joined: Wed Oct 14, 2015 1:08 am

Re: Grafana Dashboard now working... very quick

Post by mminehan » Sat Jun 02, 2018 10:20 pm

I just some clarification with regards to btmon running on a Raspberry Pi.

I have influxDB and Grafana all up and running on the Raspberry Pi and am writing data to it from Homeseer (automation software). So that part of it is fine.

Now I am trying to get the data from my GEM into influxDB on the Pi.

I have installed btmon (3.3.1). But I kept getting an error: InfluxDBClient not loaded, cannot write to InfluxDB'.

Then I realized I also had to install a client: InfluxDB-Python.

But now I am getting the following error: Exception in InfluxDBProcessor: write_points_with_precision() got an unexpected keyword argument 'tags'

I'm not sure where the problem lies. So any help appreciated.
ben
Site Admin
Posts: 4254
Joined: Fri Jun 04, 2010 9:39 am

Re: Grafana Dashboard now working... very quick

Post by ben » Mon Jun 04, 2018 3:12 pm

mminehan wrote:I just some clarification with regards to btmon running on a Raspberry Pi.

I have influxDB and Grafana all up and running on the Raspberry Pi and am writing data to it from Homeseer (automation software). So that part of it is fine.

Now I am trying to get the data from my GEM into influxDB on the Pi.

I have installed btmon (3.3.1). But I kept getting an error: InfluxDBClient not loaded, cannot write to InfluxDB'.

Then I realized I also had to install a client: InfluxDB-Python.

But now I am getting the following error: Exception in InfluxDBProcessor: write_points_with_precision() got an unexpected keyword argument 'tags'

I'm not sure where the problem lies. So any help appreciated.
Can you try my fork and see if you experience the same issue?

https://github.com/BenK22/mtools/blob/i ... n/btmon.py
Ben
Brultech Research Inc.
E: ben(at)brultech.com
mminehan
Posts: 33
Joined: Wed Oct 14, 2015 1:08 am

Re: Grafana Dashboard now working... very quick

Post by mminehan » Mon Jun 04, 2018 7:05 pm

Hi Ben,

Thanks for the reply. That is the fork I am using (3.3.1) with you email details in the notes section.

I wonder if it is a problem with the influxDB-python client?

Marty
ben
Site Admin
Posts: 4254
Joined: Fri Jun 04, 2010 9:39 am

Re: Grafana Dashboard now working... very quick

Post by ben » Tue Jun 05, 2018 9:33 am

mminehan wrote:Hi Ben,

Thanks for the reply. That is the fork I am using (3.3.1) with you email details in the notes section.

I wonder if it is a problem with the influxDB-python client?

Marty
Open up btmon.py and do a search. Type in write_points and remove the ", tags = self.tags" part of the argument. I don't think it's needed as we're not passing in tags through the configuration.
Ben
Brultech Research Inc.
E: ben(at)brultech.com
mminehan
Posts: 33
Joined: Wed Oct 14, 2015 1:08 am

Re: Grafana Dashboard now working... very quick

Post by mminehan » Tue Jun 05, 2018 9:12 pm

Ok....not quite working:
pi@raspberrypi:~/btmon $ python ./btmon.3.3.1.py -c btmon.cfg
2018/06/06 14:07:14 btmon: 3.3.1
2018/06/06 14:07:14 python: 2.7.9 (default, Sep 17 2016, 20:26:04)
[GCC 4.9.2]
2018/06/06 14:07:14 platform: linux2
2018/06/06 14:07:14 polarity is reversed
2018/06/06 14:07:14 device type: gem
2018/06/06 14:07:14 device list: ['']
2018/06/06 14:07:14 packet format: gem48ptbin
2018/06/06 14:07:14 schema: ecmread
2018/06/06 14:07:14 SOCKET: timeout: 60
2018/06/06 14:07:14 SOCKET: server host: 192.168.1.21
2018/06/06 14:07:14 SOCKET: server port: 8000
2018/06/06 14:07:14 InfluxDB: upload period: 10
2018/06/06 14:07:14 InfluxDB: host: 192.168.1.93
2018/06/06 14:07:14 InfluxDB: port: 8086
2018/06/06 14:07:14 InfluxDB: username:
2018/06/06 14:07:14 InfluxDB: map:
2018/06/06 14:07:14 InfluxDB: schema: ecmreadext
2018/06/06 14:07:26 Exception in InfluxDBProcessor: 404: 404 page not found
2018/06/06 14:07:36 Exception in InfluxDBProcessor: 404: 404 page not found
Here is my config file:
[source]
ip_read = true
device_type = gem
ip_host = 192.168.1.21
ip_port = 8000
ip_mode = client
include_current = true
reverse_polarity = true
[influxdb]
influxdb_out = true
influxdb_host = 192.168.1.93
influxdb_port = 8086
influxdb_upload_period = 10
influxdb_database = testing
influxdb_measurement = energy
influxdb_mode = row
influxdb_db_schema = ecmreadext
And I checked. There is a database called 'testing' in my InfluxDB ('show databases')

Marty
ben
Site Admin
Posts: 4254
Joined: Fri Jun 04, 2010 9:39 am

Re: Grafana Dashboard now working... very quick

Post by ben » Wed Jun 06, 2018 2:29 pm

mminehan wrote:Ok....not quite working:
pi@raspberrypi:~/btmon $ python ./btmon.3.3.1.py -c btmon.cfg
2018/06/06 14:07:14 btmon: 3.3.1
2018/06/06 14:07:14 python: 2.7.9 (default, Sep 17 2016, 20:26:04)
[GCC 4.9.2]
2018/06/06 14:07:14 platform: linux2
2018/06/06 14:07:14 polarity is reversed
2018/06/06 14:07:14 device type: gem
2018/06/06 14:07:14 device list: ['']
2018/06/06 14:07:14 packet format: gem48ptbin
2018/06/06 14:07:14 schema: ecmread
2018/06/06 14:07:14 SOCKET: timeout: 60
2018/06/06 14:07:14 SOCKET: server host: 192.168.1.21
2018/06/06 14:07:14 SOCKET: server port: 8000
2018/06/06 14:07:14 InfluxDB: upload period: 10
2018/06/06 14:07:14 InfluxDB: host: 192.168.1.93
2018/06/06 14:07:14 InfluxDB: port: 8086
2018/06/06 14:07:14 InfluxDB: username:
2018/06/06 14:07:14 InfluxDB: map:
2018/06/06 14:07:14 InfluxDB: schema: ecmreadext
2018/06/06 14:07:26 Exception in InfluxDBProcessor: 404: 404 page not found
2018/06/06 14:07:36 Exception in InfluxDBProcessor: 404: 404 page not found
Here is my config file:
[source]
ip_read = true
device_type = gem
ip_host = 192.168.1.21
ip_port = 8000
ip_mode = client
include_current = true
reverse_polarity = true
[influxdb]
influxdb_out = true
influxdb_host = 192.168.1.93
influxdb_port = 8086
influxdb_upload_period = 10
influxdb_database = testing
influxdb_measurement = energy
influxdb_mode = row
influxdb_db_schema = ecmreadext
And I checked. There is a database called 'testing' in my InfluxDB ('show databases')

Marty
Change influxdb_host = 192.168.1.93 to:

influxdb_host = 127.0.0.1

or

influxdb_host = localhost

And see if that works.
Ben
Brultech Research Inc.
E: ben(at)brultech.com
Post Reply