Project

General

Profile

Bug #65205

Accurately display ZFS vdev statistics in UI

Added by Dan Brown 11 months ago. Updated 9 months ago.

Status:
Done
Priority:
No priority
Assignee:
Waqar Ahmed
Category:
Middleware
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
No
Needs Doc:
No
Needs Merging:
No
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

See forum thread at https://forums.freenas.org/index.php?threads/11-2-pool-status-confusion.72139/ for other information and screen shots.

I was having issues with one of my disks throwing SMART errors. Not surprisingly, zpool status reported no errors, though the previous scrub made lots of repairs. In the GUI, however, the pool status page showed 6.4M checksum errors on the disk with the SMART errors. I replaced the disk, it resilvered, and the CLI continues to show no errors. However, the GUI shows 5.0M checksum errors now. Why the discrepancy?


Related issues

Related to FreeNAS - Bug #66313: Properly report zpool status in py-libzfsDone
Has duplicate FreeNAS - Bug #65916: GUI not displaying same data as zpool statusClosed
Has duplicate FreeNAS - Bug #63330: New UI displays wrong checksum error count (11.2-RELEASE)Closed

Associated revisions

Revision 8fb324b3 (diff)
Added by Waqar Ahmed 11 months ago

Accurately display ZFS Vdev Stats This commit fixes a bug where we were mixing values while retrieving from array and labelling them something which they weren't. Ticket: #65205

History

#1 Updated by Dan Brown 11 months ago

  • File debug-freenas2-20181219224104.txz added
  • Private changed from No to Yes

#2 Updated by William Grzybowski 11 months ago

  • Category changed from GUI (new) to Middleware
  • Status changed from Unscreened to Blocked
  • Target version changed from Backlog to 11.2-U3

Are you still seeing that difference?

If so, please paste:

midclt call pool.query|jq .

#3 Updated by Dan Brown 11 months ago

Yes, the discrepancy is still there.

root@freenas2:~ # midclt call pool.query|jq .
[
  {
    "id": 1,
    "name": "tank",
    "guid": "4215845880575283796",
    "encrypt": 0,
    "encryptkey": "",
    "status": "ONLINE",
    "scan": {
      "function": "RESILVER",
      "state": "FINISHED",
      "start_time": {
        "$date": 1545256872000
      },
      "end_time": {
        "$date": 1545256881000
      },
      "percentage": 0.0010803863915498368,
      "bytes_to_process": 515874816,
      "bytes_processed": 47749103026176,
      "errors": 0,
      "bytes_issued": 515874816,
      "pause": null
    },
    "topology": {
      "data": [
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "14557455717881165368",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              197333868,
              110361679,
              71565937,
              0
            ],
            "bytes": [
              0,
              19609270001664,
              2040245166080,
              1614416998400,
              0
            ],
            "size": 23914377904128,
            "allocated": 19991197605888,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 38
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/9a85d15f-8d5c-11e4-8732-0cc47a01304d",
              "guid": "7631974282667997029",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  43579825,
                  28266985,
                  46662038,
                  0
                ],
                "bytes": [
                  0,
                  4437988179968,
                  616872423424,
                  463624810496,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da11p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9afa89ae-8d5c-11e4-8732-0cc47a01304d",
              "guid": "5956855858627310804",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45240525,
                  28771952,
                  46913852,
                  0
                ],
                "bytes": [
                  0,
                  4447537324032,
                  617870213120,
                  465523724288,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da10p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9b6cc00b-8d5c-11e4-8732-0cc47a01304d",
              "guid": "8428010377024367317",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45979264,
                  28260337,
                  46514718,
                  0
                ],
                "bytes": [
                  0,
                  4457648492544,
                  616308584448,
                  462053732352,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da9p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9c501d57-8d5c-11e4-8732-0cc47a01304d",
              "guid": "13639661377487437978",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45624102,
                  28234574,
                  46585985,
                  0
                ],
                "bytes": [
                  0,
                  4445061574656,
                  616257900544,
                  463399464960,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da8p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9cc41939-8d5c-11e4-8732-0cc47a01304d",
              "guid": "5858177793587173965",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45659909,
                  28711429,
                  46837312,
                  0
                ],
                "bytes": [
                  0,
                  4446682763264,
                  617193734144,
                  465149169664,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da7p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/9d39e31d-8d5c-11e4-8732-0cc47a01304d",
              "guid": "13726649276308432681",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  45807198,
                  28239113,
                  46507460,
                  0
                ],
                "bytes": [
                  0,
                  4448988340224,
                  616204759040,
                  461905068032,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da6p2" 
            }
          ]
        },
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "17679015120352457301",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              169581954,
              104223716,
              65622450,
              0
            ],
            "bytes": [
              0,
              17876116725760,
              1950340284416,
              1527721889792,
              0
            ],
            "size": 11957188952064,
            "allocated": 10361038430208,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 48
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/f5b737a6-8e41-11e4-8732-0cc47a01304d",
              "guid": "15790560410993576468",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  50412193,
                  32605229,
                  43143310,
                  0
                ],
                "bytes": [
                  0,
                  4242319421440,
                  585073143808,
                  435730657280,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da3p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/7e2d9269-8a4e-11e5-bec2-002590de8695",
              "guid": "8165575572098393434",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51635450,
                  33033669,
                  43715754,
                  0
                ],
                "bytes": [
                  0,
                  4252103962624,
                  588910301184,
                  438506393600,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da5p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/f68f4fa9-8e41-11e4-8732-0cc47a01304d",
              "guid": "5096472268326984463",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51030680,
                  32665715,
                  43109171,
                  0
                ],
                "bytes": [
                  0,
                  4238590738432,
                  585322459136,
                  433738240000,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da4p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/f722e509-8e41-11e4-8732-0cc47a01304d",
              "guid": "12763972884203189444",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  52288981,
                  31761290,
                  43100428,
                  0
                ],
                "bytes": [
                  0,
                  4220026912768,
                  584854491136,
                  435562696704,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da2p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/56c2074c-657f-11e6-877d-002590caf340",
              "guid": "15301565423416338591",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608616579666,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  5,
                  51513746,
                  33050276,
                  43720086,
                  0
                ],
                "bytes": [
                  0,
                  4256805908480,
                  588909977600,
                  438519689216,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da1p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/755b90e1-030b-11e9-9d85-002590caf340",
              "guid": "7680351188364952000",
              "status": "ONLINE",
              "stats": {
                "timestamp": 257984780219747,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 5062656,
                "ops": [
                  3,
                  9843024,
                  21278191,
                  8910774,
                  0
                ],
                "bytes": [
                  0,
                  331811385344,
                  1820027740160,
                  81783930880,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da0p2" 
            }
          ]
        },
        {
          "type": "RAIDZ2",
          "path": null,
          "guid": "4072612480710273127",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296608616579666,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              0,
              228505796,
              112307649,
              72817988,
              0
            ],
            "bytes": [
              0,
              21142425862144,
              2281551474688,
              1774285561856,
              0
            ],
            "size": 35734127902720,
            "allocated": 18044389453824,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 12,
            "fragmentation": 21
          },
          "children": [
            {
              "type": "DISK",
              "path": "/dev/gptid/2c854638-212c-11e6-881c-002590caf340",
              "guid": "12375093470511037349",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  56040016,
                  29512863,
                  48321747,
                  0
                ],
                "bytes": [
                  0,
                  4617517244416,
                  672902025216,
                  502650327040,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da12p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/2dc4f155-212c-11e6-881c-002590caf340",
              "guid": "6008976946366008638",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  56131371,
                  30112356,
                  49657558,
                  0
                ],
                "bytes": [
                  0,
                  4653664849920,
                  686229667840,
                  507830259712,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da17p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/b7625ade-6980-11e6-877d-002590caf340",
              "guid": "9447420544122593273",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  59886095,
                  25465089,
                  47432491,
                  0
                ],
                "bytes": [
                  0,
                  4689821483008,
                  673947701248,
                  497896996864,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da14p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/1abefcac-acb9-11e6-8df3-002590caf340",
              "guid": "4948963181522411734",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  53596399,
                  29034481,
                  48618087,
                  0
                ],
                "bytes": [
                  0,
                  4564031049728,
                  675016544256,
                  503708327936,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da13p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/3d317e50-67dd-11e6-877d-002590caf340",
              "guid": "11787000073026159886",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  58659135,
                  26612792,
                  49749120,
                  0
                ],
                "bytes": [
                  0,
                  4619502100480,
                  687421403136,
                  508211367936,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da15p2" 
            },
            {
              "type": "DISK",
              "path": "/dev/gptid/192328aa-fc8e-11e6-aef3-002590caf340",
              "guid": "632205640126914662",
              "status": "ONLINE",
              "stats": {
                "timestamp": 1296608615640915,
                "read_errors": 0,
                "write_errors": 0,
                "checksum_errors": 0,
                "ops": [
                  2,
                  63587212,
                  26002028,
                  47250907,
                  0
                ],
                "bytes": [
                  0,
                  4710658027520,
                  672953692160,
                  497202835456,
                  0
                ],
                "size": 0,
                "allocated": 0,
                "configured_ashift": 12,
                "logical_ashift": 9,
                "physical_ashift": 12,
                "fragmentation": 0
              },
              "children": [],
              "device": "da16p2" 
            }
          ]
        }
      ],
      "log": [],
      "cache": [],
      "spare": []
    },
    "is_decrypted": true
  },
  {
    "id": 2,
    "name": "ssdpool",
    "guid": "3199296555261140917",
    "encrypt": 0,
    "encryptkey": "",
    "status": "ONLINE",
    "scan": {
      "function": "SCRUB",
      "state": "FINISHED",
      "start_time": {
        "$date": 1544331604000
      },
      "end_time": {
        "$date": 1544332084000
      },
      "percentage": 99.95609521865845,
      "bytes_to_process": 200385912832,
      "bytes_processed": 200473190400,
      "errors": 0,
      "bytes_issued": 200385167360,
      "pause": null
    },
    "topology": {
      "data": [
        {
          "type": "DISK",
          "path": "/dev/gptid/4573aa37-0c81-11e6-b877-002590caf340",
          "guid": "165885424137769295",
          "status": "ONLINE",
          "stats": {
            "timestamp": 1296558115642952,
            "read_errors": 0,
            "write_errors": 0,
            "checksum_errors": 0,
            "ops": [
              2,
              5242867,
              41648529,
              114940842,
              0
            ],
            "bytes": [
              0,
              405423431680,
              3121766305792,
              5673800787968,
              0
            ],
            "size": 236223201280,
            "allocated": 92758007808,
            "configured_ashift": 12,
            "logical_ashift": 9,
            "physical_ashift": 0,
            "fragmentation": 28
          },
          "children": [],
          "device": "ada1p2" 
        }
      ],
      "log": [],
      "cache": [],
      "spare": []
    },
    "is_decrypted": true
  }
]
root@freenas2:~ # 

#4 Updated by William Grzybowski 11 months ago

  • Status changed from Blocked to Unscreened
  • Assignee changed from Release Council to Waqar Ahmed

Waqar, can you please try to reproduce/investigate this discrepancy between zpool status and libzfs?

#5 Updated by William Grzybowski 11 months ago

  • Has duplicate Bug #65916: GUI not displaying same data as zpool status added

#6 Updated by Waqar Ahmed 11 months ago

  • Status changed from Unscreened to In Progress

#7 Updated by Waqar Ahmed 11 months ago

  • Status changed from In Progress to Ready for Testing

#8 Updated by Dru Lavigne 11 months ago

  • File deleted (debug-freenas2-20181219224104.txz)

#9 Updated by Dru Lavigne 11 months ago

  • Target version changed from 11.2-U3 to 11.2-U2
  • Private changed from Yes to No

#10 Updated by Dru Lavigne 11 months ago

  • Subject changed from Pool status discrepancy to Accurately display ZFS vdev statistics in UI
  • Needs Doc changed from Yes to No
  • Needs Merging changed from Yes to No

#11 Updated by Dru Lavigne 11 months ago

  • Related to Bug #66313: Properly report zpool status in py-libzfs added

#12 Updated by Dru Lavigne 10 months ago

  • Has duplicate Bug #63330: New UI displays wrong checksum error count (11.2-RELEASE) added

#15 Updated by Bonnie Follweiler 9 months ago

  • Status changed from Ready for Testing to Passed Testing
  • Needs QA changed from Yes to No

#17 Updated by Dru Lavigne 9 months ago

  • Status changed from Passed Testing to Done

Also available in: Atom PDF