Bizarre firewall/DNS problem

BoberFett

Lifer
Oct 9, 1999
37,562
9
81
My network admin and I have been scratching our heads about this problem, thought I might see if anybody has ever seen anything similar and have any suggestions.

If it was anybody else in the company, I'd say do this on your own time at home, but the owner of the company is trying to get to the Vikings website. I like my job, so I'm working on the problem. The symptom is that the page refuses to load. Using the developer tools in chrome, it looks like all of the NFL team websites reference lots of resources at many subdomains under nfl.com. All the resources from vikings.com are loading, but everything from nfl.com is timing out.

We keep digging, and it appears to be a DNS resolution problem, but only behind the firewall. Here's the basic setup:

LAN
|
Servers on core network, Windows domain controllers providing DNS
|
2 x SonicWall E5500 firewall setup for failover
|
Dumb switch to distribute DIA to firewalls
|
XO MPLS/DIA circuit into firewall
Comcast circuit into firewall


Plug a laptop into the dumb switch and bypass the firewall, nfl.com resolves just fine.

Behind the firewall, no resolution.

Log into the firewall's management interface and ping nfl.com, no problem.

That narrows the problem pretty well, it's the firewall obviously. Right?

Behind the firewall, use nslookup for random DNS queries and everything is normal for any site we try. Heck, even sites that are blocked by other services of the firewall such as content filtering (playboy.com, etc.) are working, because this is just a DNS lookup. DNS isn't being blocked.

So what kind of settings on a firewall could be blocking DNS requests for a specific domain? No other domain resolution is being blocked as far as we can tell, only nfl.com and its subdomains. Looking at nfl.com, it appears that there's some recursion and use of CDNs, load balancers, etc, but that should all be addressed by the remote DNS server and just return the address. It's almost like there's some kind of deep packet inspection going on and it's throwing out DNS requests for nfl.com, but nothing's even showing up in the logs.

I'm at a total loss.

Here's a normal nslookup resolution of nfl.com using Google's open DNS server 8.8.8.8 from my home machine:
Code:
> nfl.com 8.8.8.8
Server:  [8.8.8.8]
Address:  8.8.8.8

Non-authoritative answer:
Name:    nfl.com
Address:  23.213.196.69


And here's nslookup results for yahoo.com and nfl.com from behind the firewall
Code:
> yahoo.com 8.8.8.8
Server:  [8.8.8.8]
Address:  8.8.8.8

Non-authoritative answer:
Name:    yahoo.com
Addresses:  2001:4998:44:204::a7
          2001:4998:58:c02::a9
          2001:4998:c:a06::2:4008
          98.138.253.109
          206.190.36.45
          98.139.183.24


> nfl.com 8.8.8.8
Server:  [8.8.8.8]
Address:  8.8.8.8

DNS request timed out.
    timeout was 2 seconds.
DNS request timed out.
    timeout was 2 seconds.
DNS request timed out.
    timeout was 2 seconds.
DNS request timed out.
    timeout was 2 seconds.
*** Request to 8.8.8.8 timed-out



Here's the full detail result from nslookup:

Code:
> nfl.com 8.8.8.8
Server:  [8.8.8.8]
Address:  8.8.8.8

------------
SendRequest(), len 39
    HEADER:
        opcode = QUERY, id = 58, rcode = NOERROR
        header flags:  query, want recursion
        questions = 1,  answers = 0,  authority records = 0,  additional = 0

    QUESTIONS:
        nfl.com.[company].com, type = A, class = IN

------------
DNS request timed out.
    timeout was 2 seconds.
timeout (2 secs)
SendRequest failed
------------
SendRequest(), len 39
    HEADER:
        opcode = QUERY, id = 59, rcode = NOERROR
        header flags:  query, want recursion
        questions = 1,  answers = 0,  authority records = 0,  additional = 0

    QUESTIONS:
        nfl.com.[company].com, type = AAAA, class = IN

------------
DNS request timed out.
    timeout was 2 seconds.
timeout (2 secs)
SendRequest failed
------------
SendRequest(), len 25
    HEADER:
        opcode = QUERY, id = 60, rcode = NOERROR
        header flags:  query, want recursion
        questions = 1,  answers = 0,  authority records = 0,  additional = 0

    QUESTIONS:
        nfl.com, type = A, class = IN

------------
DNS request timed out.
    timeout was 2 seconds.
timeout (2 secs)
SendRequest failed
------------
SendRequest(), len 25
    HEADER:
        opcode = QUERY, id = 61, rcode = NOERROR
        header flags:  query, want recursion
        questions = 1,  answers = 0,  authority records = 0,  additional = 0

    QUESTIONS:
        nfl.com, type = AAAA, class = IN

------------
DNS request timed out.
    timeout was 2 seconds.
timeout (2 secs)
SendRequest failed
*** Request to 8.8.8.8 timed-out
>
 
Last edited:

CubanlB

Senior member
Oct 24, 2003
562
0
76
That's strange. Do you have GMS setup for logs or are you just trying to filter the logs on the sonicwalls for nfl.com?

Since it's not resolving at all I would guess it's getting blocked by some IDS rule or something strange like abug.

You could try to set IDS feature to only inspect from a source address object for testing to see if that really is the issue.

Most of my experience with Sonicwalls having flaky issues is to run them through a failover, reboot, fail back process. Is the E5500 a blade system like the E10000 systems? They are usually running older code, so maybe you are hitting a bug of some sort.
 

BoberFett

Lifer
Oct 9, 1999
37,562
9
81
Yep, we do have GMS, but nothing we've seen has yet pointed us in the right direction.

The E5500 is a standard rackmount unit. It's not EoL yet, and everything is under support so we'll be reaching out to SonicWall for support, but the failover-reboot cycle might be the next step. The unit was just rebooted over the weekend as it was our standard monthly maintenance, maybe something just didn't come back up correctly? /shrug

Thanks for the feedback, we'll keep hammering on it and I'll post back if we find anything.
 

CubanlB

Senior member
Oct 24, 2003
562
0
76
That sounds like the best bet with support.

We recently had an issue with the E10000 series that randomly one of the cores in each blade would spike to 100% cpu and latency through the Sonicwall was around 7000-10000 ms.

A code hotfix fixed the issue, but it took a while to get resolved. We were failing them back and forth almost daily.

Good luck with the resolution. If you get a good explanation from support, please post it up here.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |