MLD join for not propagated into TIB

[marek22k]

Hello,

I am trying to set up a PIM configuration. I have a neighbor who also runs a PIM daemon. I now have unicast routes that are to be used for multicast RPF in kernel table 20.
frr seems to understand the routes and my request to perform multicast, but it does not seem to install a multicast route and instead outputs an warning/error message.

frr configuration:

!
frr version 10.3
frr defaults traditional
hostname lab
log syslog informational
no ip forwarding
service integrated-vtysh-config
!
interface ffhlmulticast
 ipv6 pim
exit
!
interface veth-pim
 ipv6 mld
exit
!
router pim6
 embedded-rp
exit
!
end

interfaces:

22: veth-pim@veth-mld: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 5a:20:d6:a0:ff:57 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::5820:d6ff:fea0:ff57/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
23: veth-mld@veth-pim: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether ba:fe:15:ca:7d:02 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::b8fe:15ff:feca:7d02/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
27: pim6reg@NONE: <NOARP,UP,LOWER_UP> mtu 1452 qdisc noqueue state UNKNOWN group default qlen 1000
    link/pimreg 
28: ffhlmulticast: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1420 qdisc noqueue state UNKNOWN group default qlen 1000
    link/none 
    inet6 fe80::2924/64 scope link 
       valid_lft forever preferred_lft forever

frr log:

Nov 13 23:44:17 lab pim6d[21040]: [SPXBS-HQCC1] PIM INTERFACE UP: on interface ffhlmulticast ifindex=28
Nov 13 23:44:17 lab pim6d[21040]: [JTV2R-NFGET] PIM NEIGHBOR UP: neighbor fe80::b398:287f:a065:b594 on interface ffhlmulticast
Nov 13 23:44:29 lab pim6d[21040]: [XPHH2-4VHCA] [MLD default:veth-pim] general expiry timer
Nov 13 23:45:01 lab pim6d[21040]: [XPHH2-4VHCA] [MLD default:veth-pim] general expiry timer
Nov 13 23:45:08 lab pim6d[21040]: [YFAW6-MBBKP] MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB
Nov 13 23:45:08 lab pim6d[21040]: [YFAW6-MBBKP] MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB

frr output:

Hello, this is FRRouting (version 10.3).
Copyright 1996-2005 Kunihiro Ishiguro, et al.

lab# show ipv6 pim interface
 Interface      State  Address                    PIM Nbrs  PIM DR                     FHR  IfChannels  
 ffhlmulticast  up     fe80::2924                 1         fe80::b398:287f:a065:b594  0    0           
 pim6reg        up     ::                         0         local                      0    0           
 veth-pim       up     fe80::5820:d6ff:fea0:ff57  0         local                      0    0           

lab# show ipv6 pim neighbor
 Interface      Neighbor                   Uptime    Holdtime  DR Pri  
 ffhlmulticast  fe80::b398:287f:a065:b594  00:01:22  00:01:20  1       

lab# show ipv6 pim state
Codes: J -> Pim Join, I -> MLD Report, S -> Source, * -> Inherited from (*,G), V -> VxLAN, M -> Muted
 Active  Source  Group                                RPT  IIF     OIL  
 0       *       ff7e:240:fdef:ffc0:3dd7:0:5458:2000  y    <iif?>       

lab# show ipv6 pim rp-info
 RP address         group/prefix-list                        OIF            I am RP  Source  Group-Type  
 fdef:ffc0:3dd7::2  ff7e:240:fdef:ffc0:3dd7:0:5458:2000/128  ffhlmulticast  no       Embedd  ASM         

lab# show ipv6 pim rpf
RPF Cache Refresh Delay:    50 msecs
RPF Cache Refresh Timer:    0 msecs
RPF Cache Refresh Requests: 3
RPF Cache Refresh Events:   3
RPF Cache Refresh Last:     00:01:22
Nexthop Lookups:            6
Nexthop Lookups Avoided:    0

 Source  Group  RpfIface  RpfAddress  RibNextHop  Metric  Pref  

lab# show ipv6 pim upstream
 Iif  Source  Group  State  Uptime  JoinTimer  RSTimer  KATimer  RefCnt  

lab# show ipv6 mld interface
 Interface  State  Address                    V  Querier  QuerierIp                  Query Timer   Uptime        
 veth-pim   up     fe80::5820:d6ff:fea0:ff57  2  local    fe80::5820:d6ff:fea0:ff57  00:01:47.751  00:03:24.750  

lab# show ipv6 mld statistics
Interface: veth-pim
  v2 reports received             16
  v1 reports received             0
  v1 done received                0
  v2 *,* queries received         4
  v2 *,G queries received         2
  v2 S,G queries received         0
  v2 S-bit queries received       0
  v1 *,* queries received         0
  v1 *,G queries received         0
  v2 *,* queries sent             4
  v2 *,G queries sent             2
  v2 S,G queries sent             0
  v1 *,* queries sent             0
  v1 *,G queries sent             0
  TX errors                       0
  RX dropped (checksum error)     0
  RX dropped (invalid source)     0
  RX dropped (invalid dest.)      0
  RX dropped (missing alert)      0
  RX dropped (malformed pkt.)     0
  RX truncated reports            0

lab# show ipv6 multicast
Router MLAG Role: NONE
Mroute socket descriptor: 12(default)
PIM Register socket descriptor: 11(default)
Mroute socket uptime: 00:03:25

Zclient update socket: 14 failures=0
Zclient lookup socket: 17 failures=0

Maximum highest VifIndex: 255

Upstream Join Timer: 60 secs
Join/Prune Holdtime: 210 secs
PIM ECMP: Disable
PIM ECMP Rebalance: Disable

RPF Cache Refresh Delay:    50 msecs
RPF Cache Refresh Timer:    0 msecs
RPF Cache Refresh Requests: 3
RPF Cache Refresh Events:   3
RPF Cache Refresh Last:     00:01:22
Nexthop Lookups:            6
Nexthop Lookups Avoided:    0

Scan OIL - Last: 00:01:22  Events: 3
MFC Add  - Last: --:--:--  Events: 0
MFC Del  - Last: --:--:--  Events: 0

 Interface      Address                    ifi  Vif  PktsIn  PktsOut  BytesIn  BytesOut  
 ffhlmulticast  fe80::2924                 28   1    0       0        0        0         
 pim6reg        *                          27   0    0       0        0        0         
 veth-pim       fe80::5820:d6ff:fea0:ff57  22   3    0       0        0        0         

lab# show ipv6 mroute
IP Multicast Routing Table
Flags: S - Sparse, C - Connected, P - Pruned
       R - SGRpt Pruned, F - Register flag, T - SPT-bit set
 Source  Group  Flags  Proto  Input  Output  TTL  Uptime  

mcjoin:

/home/marek/mcjoin/src/mcjoin -j -i veth-mld ff7e:240:fdef:ffc0:3dd7:0:5458:2000 -o

With debug enabled:

 tib_sg_gm_join: Failure to add local membership for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)

Nov 14 00:16:20 lab pim6d[23299]: MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB
Nov 14 00:16:21 lab pim6d[23299]: [RAGSM-MMWEH] tib_sg_gm_join: Failure to add local membership for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)
Nov 14 00:16:21 lab pim6d[23299]: pim_channel_add_oif(tib_sg_gm_join): (S,G)=(*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000): proto_mask=1 OIF=veth-pim vif_index=2: DONE
Nov 14 00:16:21 lab pim6d[23299]: [YFAW6-MBBKP] MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB
Nov 14 00:16:21 lab pim6d[23299]: pim_ifchannel_local_membership_add:(*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000) PIM is not configured on this interface veth-pim
Nov 14 00:16:21 lab pim6d[23299]: tib_sg_gm_join: Failure to add local membership for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)
Nov 14 00:16:21 lab pim6d[23299]: pim_upstream_mroute_update(pim_channel_del_oif) (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000) IIF: (?), OIFS:  mroute not ready to be installed; skip
Nov 14 00:16:21 lab pim6d[23299]: pim_channel_del_oif(tib_sg_gm_join): (S,G)=(*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000): proto_mask=1 IIF:Unknown OIF=veth-pim vif_index=2
Nov 14 00:16:21 lab pim6d[23299]: MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB

Does anyone know why this is happening? How can I fix the error MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB?

[marek22k]

When configuring:

lab(config)# interface veth-pim
lab(config-if)# ipv6 pim
lab(config-if)# end

Nov 14 00:18:19 lab pim6d[23299]: [MLD default:veth-pim (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)] triggered query
Nov 14 00:18:19 lab pim6d[23299]: [MLD default:veth-pim] MLD query fe80::5820:d6ff:fea0:ff57 -> ff7e:240:fdef:ffc0:3dd7:0:5458:2000 (grp=ff7e:240:fdef:ffc0:3dd7:0:5458:2000, 0 srcs)
Nov 14 00:18:19 lab pim6d[23299]: [MLD default:veth-pim] query timers: QRV=2 max_resp=10000ms qqic=125000ms expire_wait=00:02:15.010
Nov 14 00:18:20 lab pim6d[23299]: [MEXEY-M6N2E] tib_sg_gm_join: add_oif() failed with return=-3
Nov 14 00:18:20 lab pim6d[23299]: [YFAW6-MBBKP] MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB
Nov 14 00:18:20 lab pim6d[23299]: ../pimd/pim_oil.c pim_channel_add_oif: existing protocol mask 1 requested OIF veth-pim (vif_index=2, min_ttl=1) for channel (S,G)=(*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)
Nov 14 00:18:20 lab pim6d[23299]: tib_sg_gm_join: add_oif() failed with return=-3
Nov 14 00:18:20 lab pim6d[23299]: MLD join for (*,ff7e:240:fdef:ffc0:3dd7:0:5458:2000)%veth-pim not propagated into TIB

But I don't understand by I should configure PIM on a client interface.

[marek22k]

Seems the reason was that pim was not enabled on the client interface. It works with:

interface veth-pim
 ipv6 mld
 ipv6 pim
 ipv6 pim passive
exit