The hall makes more sense when you plan the whole area. Laugardalur lets a short venue stop become part of a pool, park, garden, zoo, or museum cluster.
Reykjavík city sources describe Laugardalur as a major sports and recreation area with Laugardalshöll, Laugardalslaug, Laugardalsvöllur, the ice rink, walking and cycling paths, the botanic garden, and family attractions. That cluster is the reason the hall belongs on a travel guide page.
For most travelers, the cleanest plan is one venue reason plus one nearby stop. A match plus the pool works well. A quick exterior look plus Ásmundarsafn or Reykjavík Family Park and Zoo can work for slower city time.
Do not stretch the area just because it has several nearby choices. Pick the one that solves the day’s real need: water, animals, sculpture, park time, or a scheduled event.