Bonjour gateway does not recognize all virtual interfaces after complete update (CVG)

  • 1
  • Question
  • Updated 4 years ago
  • Doesn't Need an Answer
The virtual interfaces does not come up automatically after a complete update or hard reboot.

We experience issues with the CVG running 6.1r2 on a ESXi machine.
Some background information about the network:
There are 19 VLAN's where vlan 12 is the mgt vlan.
There are more than a 1000 bonjour services on the network. (~80 Apple TV's, ~800 ipads, etc)

Now this is the layer3 interface list after a complete configuration update(with reboot) or hard reboot:


I found a workarround to change the bonjour settings by adding or removing a random scanning vlan and doing a quick update(not complete update with reboot)


After the quick update the results are more like my network setup:


Sometimes i have to do this workarround several times before the CVG recognize all the virtual interfaces. The biggest problem is that all my effort is lost when i do a complete update or we have a power failure which causes a hard reboot. What is going wrong?
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
  • confused

Posted 4 years ago

  • 1
Photo of Andrew MacTaggart

Andrew MacTaggart, Champ

  • 483 Posts
  • 86 Reply Likes
I would recommend

creating a vlan just for appleTVs

scan all needed vlans

but filter only the appletv vlan to advertise to the user vlans

the 800 ipads only need to hear the advertisements, i don't suspect that the need to offer any services.

the CVG may allow more bonjour services to be advertised compared to an AP
for AP 1000 seems to be the limit and the math is # of services per device X # of vlans X

one thing is that as far as I am aware ipads can only see 64 devices in the mirror list - not sure if this has cause an issue for you.

for the AP BGD i would ssh and disable and enable the Bonjour gateway and this would recreate the BGD sub interfaces
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
Hi Andrew,

Ok, at this moment the appleTV's are in more VLAN's, but we already got that on the todo list. Can you explain why this is technically recommended?

We assigned 2GB memory to the virtual machine which is actually using less then 512MB, so depending on the OS limitation, the hardware is ready to serve all the growing bonjour needs.

I googled around but cannot find anything about the 64 device list limitation of the ipads or other IOS devices. Is this your experience or do you have any references for this?

Disabling and enabling the bonjour Gateway via SSH is a workaround, which is ok for a Lab environment, but we want to set this up in production. It cannot be true that i need to setup an cronjob for this to make sure that all my VLAN's are served. Why is this happening at all? Is this a known bug?
Photo of Andrew MacTaggart

Andrew MacTaggart, Champ

  • 483 Posts
  • 86 Reply Likes
It's my own personal recommendation
for me
I like to filter the official Bonjour services [for apple TV] to the user population.

I don't need Sally advertising to the whole community that she is running an air server or something that uses the same services.

We had Apple Visit our school and they specifically told us that 64 mirrored devices in the ios device list was the max and that our vlan design should be designed in such a way as not to loose devices from the list. But this was with ios 6, so maybe that has changed.

I would be interested to see if your 80 AppleTVs show up

We have 50 AppleTVs in 1 Bonjour realm

I am not sure why "this is happening" Less might be more in this case.

Maybe Aerohive Folks can shed some light on the matter.
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
Thanks Andrew,

I will count the AppleTV list soon and let you know, however providing the end-users an 80-AppleTV long list is not really user-friendly. We are thinking to split the Wireless and the (future) AppleTV VLAN in 4 so the user will never see more than 20 AppleTV's.

This means at least:
4 Student VLAN's
4 Teacher VLAN's
4 IT VLAN's
4 Guest VLAN's
4 Apple TV VLAN's
etc.

So the VLAN amount will continue to grow instead of decrease.
Photo of Andrew MacTaggart

Andrew MacTaggart, Champ

  • 483 Posts
  • 86 Reply Likes
Cool

I will keep an eye out.
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
I further investigated the problem and tried to reproduce the problem in a lab environment. My lab environment is a copy of the production environment regarding VLAN's, Subnets, etc.(without that many devices and traffic of course)
Unfortunately i was not able to reproduce the issue.. The subinterfaces where all immediately created after reboot, no matter what i changed in the configuration.

In my lab environment i had only 2 Apple TV's in different vlan's. I can conclude that the lack of traffic made my lab environment work. Or i can better say, there is some incompatibility between my production environment and the Bonjour Gateway.

In production, the Bonjour Gateway scans more than 1000 different services accross the vlan's and have to advertise approximately 240 filtered (apple TV)
services over 14 vlan's. The free bonjour Gateway should have a limit of a 1000 advertisements because of a memory limit. I assigned 4GB of memory to the CVG while the CVG is using no more than 200MB. So that should not be an issue.

What else can go wrong?
Photo of Andrew MacTaggart

Andrew MacTaggart, Champ

  • 483 Posts
  • 86 Reply Likes
Well I notice on the APs that the Bgd0.X interfaces won't be created if an dhcp address can not be obtained. So maybe there is some delay on obtaining dhcp offers on all the interfaces.

On the AP if there is no dhcp available the Bgd0.X interface does not get created, and then there does not seem to be a process if dhcp for the vlan does become available to build the new interface without a no bonjour-gateway enable and a bonjour-gateway enable.

So maybe it is a timing issue where the BGD builds the interfaces before all the offers come in.

Just a guess.
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
Disabling and enabling the bonjour gateway will create more (sometimes all) subinterfaces.
The dhcp server in my lab and production differs. (Mikrotik in lab / Windows server in production)... I am not aware of any limits of the Windows dhcp server that is able to create this issue but i will check this with the Windows system administrator.

However, when i don't restart the bonjour gateway, the subinterface creation will not complete (i waited > 10 minuts). So it looks like aerohive will only try once to create the interfaces and will time-out when the dhcp server offers the leases not quick enough.
.
Photo of Nick Lowe

Nick Lowe, Official Rep

  • 2491 Posts
  • 451 Reply Likes
If you can reproduce the issue with 6.1r3, this certainly seems worthy of a support case.
Photo of Bas de Gruijter

Bas de Gruijter

  • 8 Posts
  • 0 Reply Likes
we are running 6.1r2 because 6.1r3 is not released yet.. I checked the release-notes for 6.1r3 and found nothing about VLAN's or virtual interfaces.

http://www.aerohive.com/330000/docs/h...