Project

General

Profile

Bug #65205

Accurately display ZFS vdev statistics in UI

Added by Dan Brown over 1 year ago. Updated over 1 year ago.

Status:
Done
Priority:
No priority
Assignee:
Waqar Ahmed
Category:
Middleware
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
No
Needs Doc:
No
Needs Merging:
No
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

See forum thread at https://forums.freenas.org/index.php?threads/11-2-pool-status-confusion.72139/ for other information and screen shots.

I was having issues with one of my disks throwing SMART errors. Not surprisingly, zpool status reported no errors, though the previous scrub made lots of repairs. In the GUI, however, the pool status page showed 6.4M checksum errors on the disk with the SMART errors. I replaced the disk, it resilvered, and the CLI continues to show no errors. However, the GUI shows 5.0M checksum errors now. Why the discrepancy?


Related issues

Related to FreeNAS - Bug #66313: Properly report zpool status in py-libzfsDone
Has duplicate FreeNAS - Bug #65916: GUI not displaying same data as zpool statusClosed
Has duplicate FreeNAS - Bug #63330: New UI displays wrong checksum error count (11.2-RELEASE)Closed

Associated revisions

Revision 8fb324b3 (diff)
Added by Waqar Ahmed over 1 year ago

Accurately display ZFS Vdev Stats This commit fixes a bug where we were mixing values while retrieving from array and labelling them something which they weren't. Ticket: #65205

History

#1 Updated by Dan Brown over 1 year ago

  • File debug-freenas2-20181219224104.txz added
  • Private changed from No to Yes

#2 Updated by William Grzybowski over 1 year ago

  • Category changed from GUI (new) to Middleware
  • Status changed from Unscreened to Blocked
  • Target version changed from Backlog to 11.2-U3

Are you still seeing that difference?

If so, please paste:

midclt call pool.query|jq .

#3 Updated by Dan Brown over 1 year ago

Yes, the discrepancy is still there.

root@freenas2:~ # midclt call pool.query|jq .
[
  {
    "id": 1,
    "name": "tank",
    "guid": "4215845880575283796",
    "encrypt": 0,
    "encryptkey": "",
    "status": "ONLINE",
    "scan": {
      "function": "RESILVER",
      "state": "FINISHED",
      "start_time": {
        "$date": 1545256872000
      },
      "end_time": {
        "$date": 1545256881000
      },
      "percentage": 0.0010803863915498368,
      "bytes_to_process": 515874816,
      "bytes_processed": 47749103026176,
      "errors": 0,
      "bytes_issued": 515874816,
      "pause": null
    },
    "topology": {
      "data": [
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "14557455717881165368",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              197333868,
              110361679,
              71565937,
              0
            ],
            "bytes": [
              0,
              19609270001664,
              2040245166080,
              1614416998400,
              0
            ],
            "size": 23914377904128,
            "allocated": 19991197605888,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 38
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/9a85d15f-8d5c-11e4-8732-0cc47a01304d",
              "guid": "7631974282667997029",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  43579825,
                  28266985,
                  46662038,
                  0
                ],
                "bytes": [
                  0,
                  4437988179968,
                  616872423424,
                  463624810496,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da11p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9afa89ae-8d5c-11e4-8732-0cc47a01304d",
              "guid": "5956855858627310804",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45240525,
                  28771952,
                  46913852,
                  0
                ],
                "bytes": [
                  0,
                  4447537324032,
                  617870213120,
                  465523724288,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da10p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9b6cc00b-8d5c-11e4-8732-0cc47a01304d",
              "guid": "8428010377024367317",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45979264,
                  28260337,
                  46514718,
                  0
                ],
                "bytes": [
                  0,
                  4457648492544,
                  616308584448,
                  462053732352,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da9p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9c501d57-8d5c-11e4-8732-0cc47a01304d",
              "guid": "13639661377487437978",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45624102,
                  28234574,
                  46585985,
                  0
                ],
                "bytes": [
                  0,
                  4445061574656,
                  616257900544,
                  463399464960,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da8p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9cc41939-8d5c-11e4-8732-0cc47a01304d",
              "guid": "5858177793587173965",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45659909,
                  28711429,
                  46837312,
                  0
                ],
                "bytes": [
                  0,
                  4446682763264,
                  617193734144,
                  465149169664,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da7p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9d39e31d-8d5c-11e4-8732-0cc47a01304d",
              "guid": "13726649276308432681",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45807198,
                  28239113,
                  46507460,
                  0
                ],
                "bytes": [
                  0,
                  4448988340224,
                  616204759040,
                  461905068032,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da6p2" 
            }
          ]
        },
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "17679015120352457301",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              169581954,
              104223716,
              65622450,
              0
            ],
            "bytes": [
              0,
              17876116725760,
              1950340284416,
              1527721889792,
              0
            ],
            "size": 11957188952064,
            "allocated": 10361038430208,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 48
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/f5b737a6-8e41-11e4-8732-0cc47a01304d",
              "guid": "15790560410993576468",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  50412193,
                  32605229,
                  43143310,
                  0
                ],
                "bytes": [
                  0,
                  4242319421440,
                  585073143808,
                  435730657280,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da3p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/7e2d9269-8a4e-11e5-bec2-002590de8695",
              "guid": "8165575572098393434",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51635450,
                  33033669,
                  43715754,
                  0
                ],
                "bytes": [
                  0,
                  4252103962624,
                  588910301184,
                  438506393600,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da5p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/f68f4fa9-8e41-11e4-8732-0cc47a01304d",
              "guid": "5096472268326984463",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51030680,
                  32665715,
                  43109171,
                  0
                ],
                "bytes": [
                  0,
                  4238590738432,
                  585322459136,
                  433738240000,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da4p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/f722e509-8e41-11e4-8732-0cc47a01304d",
              "guid": "12763972884203189444",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  52288981,
                  31761290,
                  43100428,
                  0
                ],
                "bytes": [
                  0,
                  4220026912768,
                  584854491136,
                  435562696704,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da2p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/56c2074c-657f-11e6-877d-002590caf340",
              "guid": "15301565423416338591",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51513746,
                  33050276,
                  43720086,
                  0
                ],
                "bytes": [
                  0,
                  4256805908480,
                  588909977600,
                  438519689216,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da1p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/755b90e1-030b-11e9-9d85-002590caf340",
              "guid": "7680351188364952000",
              "status": "ONLINE",
              "stats": {
                "timestamp": 257984780219747,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 5062656,
                "ops": [
                  3,
                  9843024,
                  21278191,
                  8910774,
                  0
                ],
                "bytes": [
                  0,
                  331811385344,
                  1820027740160,
                  81783930880,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da0p2" 
            }
          ]
        },
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "4072612480710273127",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              228505796,
              112307649,
              72817988,
              0
            ],
            "bytes": [
              0,
              21142425862144,
              2281551474688,
              1774285561856,
              0
            ],
            "size": 35734127902720,
            "allocated": 18044389453824,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 21
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/2c854638-212c-11e6-881c-002590caf340",
              "guid": "12375093470511037349",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  56040016,
                  29512863,
                  48321747,
                  0
                ],
                "bytes": [
                  0,
                  4617517244416,
                  672902025216,
                  502650327040,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da12p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/2dc4f155-212c-11e6-881c-002590caf340",
              "guid": "6008976946366008638",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  56131371,
                  30112356,
                  49657558,
                  0
                ],
                "bytes": [
                  0,
                  4653664849920,
                  686229667840,
                  507830259712,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da17p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/b7625ade-6980-11e6-877d-002590caf340",
              "guid": "9447420544122593273",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  59886095,
                  25465089,
                  47432491,
                  0
                ],
                "bytes": [
                  0,
                  4689821483008,
                  673947701248,
                  497896996864,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da14p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/1abefcac-acb9-11e6-8df3-002590caf340",
              "guid": "4948963181522411734",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  53596399,
                  29034481,
                  48618087,
                  0
                ],
                "bytes": [
                  0,
                  4564031049728,
                  675016544256,
                  503708327936,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da13p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/3d317e50-67dd-11e6-877d-002590caf340",
              "guid": "11787000073026159886",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  58659135,
                  26612792,
                  49749120,
                  0
                ],
                "bytes": [
                  0,
                  4619502100480,
                  687421403136,
                  508211367936,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da15p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/192328aa-fc8e-11e6-aef3-002590caf340",
              "guid": "632205640126914662",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  63587212,
                  26002028,
                  47250907,
                  0
                ],
                "bytes": [
                  0,
                  4710658027520,
                  672953692160,
                  497202835456,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da16p2" 
            }
          ]
        }
      ],
      "log": [],
      "cache": [],
      "spare": []
    },
    "is_decrypted": true
  },
  {
    "id": 2,
    "name": "ssdpool",
    "guid": "3199296555261140917",
    "encrypt": 0,
    "encryptkey": "",
    "status": "ONLINE",
    "scan": {
      "function": "SCRUB",
      "state": "FINISHED",
      "start_time": {
        "$date": 1544331604000
      },
      "end_time": {
        "$date": 1544332084000
      },
      "percentage": 99.95609521865845,
      "bytes_to_process": 200385912832,
      "bytes_processed": 200473190400,
      "errors": 0,
      "bytes_issued": 200385167360,
      "pause": null
    },
    "topology": {
      "data": [
        {
          "type": "DISK",
          "path": "/dev/gptid/4573aa37-0c81-11e6-b877-002590caf340",
          "guid": "165885424137769295",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296558115642952,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              2,
              5242867,
              41648529,
              114940842,
              0
            ],
            "bytes": [
              0,
              405423431680,
              3121766305792,
              5673800787968,
              0
            ],
            "size": 236223201280,
            "allocated": 92758007808,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 0,
            "fragmentation": 28
          },
          "children": [],
          "device": "ada1p2" 
        }
      ],
      "log": [],
      "cache": [],
      "spare": []
    },
    "is_decrypted": true
  }
]
root@freenas2:~ # 

#4 Updated by William Grzybowski over 1 year ago

  • Status changed from Blocked to Unscreened
  • Assignee changed from Release Council to Waqar Ahmed

Waqar, can you please try to reproduce/investigate this discrepancy between zpool status and libzfs?

#5 Updated by William Grzybowski over 1 year ago

  • Has duplicate Bug #65916: GUI not displaying same data as zpool status added

#6 Updated by Waqar Ahmed over 1 year ago

  • Status changed from Unscreened to In Progress

#7 Updated by Waqar Ahmed over 1 year ago

  • Status changed from In Progress to Ready for Testing

#8 Updated by Dru Lavigne over 1 year ago

  • File deleted (debug-freenas2-20181219224104.txz)

#9 Updated by Dru Lavigne over 1 year ago

  • Target version changed from 11.2-U3 to 11.2-U2
  • Private changed from Yes to No

#10 Updated by Dru Lavigne over 1 year ago

  • Subject changed from Pool status discrepancy to Accurately display ZFS vdev statistics in UI
  • Needs Doc changed from Yes to No
  • Needs Merging changed from Yes to No

#11 Updated by Dru Lavigne over 1 year ago

  • Related to Bug #66313: Properly report zpool status in py-libzfs added

#12 Updated by Dru Lavigne over 1 year ago

  • Has duplicate Bug #63330: New UI displays wrong checksum error count (11.2-RELEASE) added

#15 Updated by Bonnie Follweiler over 1 year ago

  • Status changed from Ready for Testing to Passed Testing
  • Needs QA changed from Yes to No

#17 Updated by Dru Lavigne over 1 year ago

  • Status changed from Passed Testing to Done

Also available in: Atom PDF