Article https://doi.org/10.1038/s41467-023-44190-2 Competing itinerant and local spin interactions in kagome metal FeGe Lebing Chen1, Xiaokun Teng 1, Hengxin Tan 2, Barry L. Winn3, Garrett E. Granroth 3, Feng Ye 3, D. H. Yu 4, R. A. Mole 4, Bin Gao 1, Binghai Yan 2, Ming Yi1 & Pengcheng Dai 1 The combination of a geometrically frustrated lattice, and similar energy scales between degrees of freedom endows two-dimensional Kagome metals with a rich array of quantumphases and renders them ideal for studying strong electron correlations and band topology. The Kagome metal, FeGe is a noted example of this, exhibiting A-type collinear antiferromagnetic (AFM) order at TN ≈ 400K, then establishes a charge density wave (CDW) phase coupled with AFM ordered moment below TCDW ≈ 110 K, and finally forms a c-axis double cone AFM structure around TCanting ≈ 60K. Here we use neutron scattering to demonstrate the presence of gapless incommensurate spin excitations asso- ciatedwith the double cone AFM structure of FeGe at temperatures well above TCanting and TCDW that merge into gapped commensurate spin waves from the A-type AFMorder. Commensurate spinwaves follow the Bose factor and fit the Heisenberg Hamiltonian, while the incommensurate spin excitations, emer- ging below TN where AFM order is commensurate, start to deviate from the Bose factor around TCDW, and peaks at TCanting. This is consistent with a critical scattering of a second order magnetic phase transition with decreasing tem- perature. By comparing these results with density functional theory calcula- tions, we conclude that the incommensurate magnetic structure arises from the nested Fermi surfaces of itinerant electrons and the formation of a spin density wave order. Materials with flat electronic bands near the Fermi level are inter- esting because they display a wide range of novel phenomena, such as unconventional superconductivity1,2, nematicity3, strange metallicity4, generalized Wigner crystal state5, fractional Chern insulator states6, time reversal symmetry breaking charge order7, and exotic magnetism8. This arises because a system exhibiting a large density of states near the Fermi level can respond to instabilities under different types of interaction when the Coulomb repulsive energy is on the same order as the electronic kinetic energy, giving rise to exotic properties due to electron correlations. While flat electronic bands near the Fermi level can be achieved throughmagic- angle twisted bilayer graphene1, flat electronic bands can also natu- rally occur in metals with two-dimensional (2D) kagome lattice structure from destructive interference of electronic hopping path- ways around the kagome bracket9–11. For this reason, there is much interest in studying metals with kagome lattice structure12–15. For weakly electron correlated kagomemetals such asAV3Sb5 (A = Cs, Rb, K), where electronic structures can be well-described by density functional theory (DFT) and flat electronic bands are far away from the Fermi level, there are coexisting charge density wave (CDW) and superconductivity without long-range magnetic order16–21. For electron-correlated kagome metals such as the FeSn family, where Received: 18 August 2023 Accepted: 4 December 2023 Check for updates 1Department of Physics and Astronomy, Rice University, Houston, TX 77005, USA. 2Department of CondensedMatter Physics, Weizmann Institute of Science, Rehovot 7610001, Israel. 3Neutron Scattering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA. 4Australian Nuclear Science and Tech- nology Organisation, Lucas Heights, NSW 2234, Australia. e-mail: pdai@rice.edu Nature Communications | (2024) 15:1918 1 12 34 56 78 9 0 () :,; 12 34 56 78 9 0 () :,; http://orcid.org/0000-0002-7185-085X http://orcid.org/0000-0002-7185-085X http://orcid.org/0000-0002-7185-085X http://orcid.org/0000-0002-7185-085X http://orcid.org/0000-0002-7185-085X http://orcid.org/0000-0002-6366-4731 http://orcid.org/0000-0002-6366-4731 http://orcid.org/0000-0002-6366-4731 http://orcid.org/0000-0002-6366-4731 http://orcid.org/0000-0002-6366-4731 http://orcid.org/0000-0002-7583-8778 http://orcid.org/0000-0002-7583-8778 http://orcid.org/0000-0002-7583-8778 http://orcid.org/0000-0002-7583-8778 http://orcid.org/0000-0002-7583-8778 http://orcid.org/0000-0001-7477-4648 http://orcid.org/0000-0001-7477-4648 http://orcid.org/0000-0001-7477-4648 http://orcid.org/0000-0001-7477-4648 http://orcid.org/0000-0001-7477-4648 http://orcid.org/0000-0003-2995-0336 http://orcid.org/0000-0003-2995-0336 http://orcid.org/0000-0003-2995-0336 http://orcid.org/0000-0003-2995-0336 http://orcid.org/0000-0003-2995-0336 http://orcid.org/0000-0001-5018-4221 http://orcid.org/0000-0001-5018-4221 http://orcid.org/0000-0001-5018-4221 http://orcid.org/0000-0001-5018-4221 http://orcid.org/0000-0001-5018-4221 http://orcid.org/0000-0002-2853-2362 http://orcid.org/0000-0002-2853-2362 http://orcid.org/0000-0002-2853-2362 http://orcid.org/0000-0002-2853-2362 http://orcid.org/0000-0002-2853-2362 http://orcid.org/0000-0003-2164-5839 http://orcid.org/0000-0003-2164-5839 http://orcid.org/0000-0003-2164-5839 http://orcid.org/0000-0003-2164-5839 http://orcid.org/0000-0003-2164-5839 http://orcid.org/0000-0002-6088-3170 http://orcid.org/0000-0002-6088-3170 http://orcid.org/0000-0002-6088-3170 http://orcid.org/0000-0002-6088-3170 http://orcid.org/0000-0002-6088-3170 http://crossmark.crossref.org/dialog/?doi=10.1038/s41467-023-44190-2&domain=pdf http://crossmark.crossref.org/dialog/?doi=10.1038/s41467-023-44190-2&domain=pdf http://crossmark.crossref.org/dialog/?doi=10.1038/s41467-023-44190-2&domain=pdf http://crossmark.crossref.org/dialog/?doi=10.1038/s41467-023-44190-2&domain=pdf mailto:pdai@rice.edu electronic structures can only be approximately described by re- normalized DFT calculations22, there is long-range magnetic order but without CDW and superconductivity12,22–25. Recently, FeGe, iso- electronic to FeSn26–31, was found to have CDW order deep inside the antiferromagnetic (AFM) orderedphase that couples with amagnetic ordered moment32,33. FeGe is the only known magnetic kagome sys- tem to develop CDW order. By comparing the temperature depen- dence of electronic structures measured by angle-resolved photoemission spectroscopy (ARPES) with DFT calculations, it was found that FeGe is a moderately electron-correlated magnet where the density of states near the Fermi level is dominated by Fe 3d orbitals. Furthermore, DFT calculations suggest that the geome- trically frustrated flat bands are near the Fermi level in the high- temperature paramagnetic state, and are spin-split in the AFMphase, out of which the CDW order is observed to develop34. Therefore, it is interesting to study the potential connection between electronic structure and magnetism in FeGe. At the Néel temperature TN ≈ 400K, FeGe exhibits A-type AFM orderwith c-axis polarizedmoments in alternating ferromagnetic (FM) kagome layers (Fig. 1a)30,31. Then at TCDW ≈ 110K, a 2 × 2 × 2 CDW phase occurs that enhances the ordered magnetic moments32–35. Finally, below TCanting ≈ 60K, incommensurate magnetic peaks appear around magnetic Bragg peaks along the c-axis at qIC = (L ± δ), where δ = 0.04 r.l.u. and L = ± 1/2, 3/2,⋯ , that hasbeen interpreted as evidence for the c-axis double-cone AFM structure (Fig. 1b–g)30–32. Similar observations are also found in kagomemagnets YbMn6Ge6−xSnx 36, YMn6Sn6 37,38, and YMn6Ge6 39. In metallic crystalline solids, magnetic order can be described by either a quantum spin model with local moments on each atomic site (Fig. 1a–c)40,41, or quasiparticle spin-flip excitations between the valence and conduction bands near the Fermi level (termed spin density wave) as the consequence of electron-electron correlations (Fig. 1h–j)42. At the longwavelength limit (smallmomentum transferq), spin waves should be well-defined bosonicmodes and are expected to follow the Bose population factor in the magnetic ordered state. In addition, the energy (E) and momentum dispersion of spin waves can be fitted by a Heisenberg Hamiltonian with several nearest neighbor (NN) exchange couplings, thus providing direct information on the strength of the itinerant electron induced Ruderman-Kittel-Kasuya- Yosida (RKKY) magnetic interactions41. For materials with strong electron correlations such as copper oxide superconductors La2−x(Ba,Sr)xCuO4 43,44, YBa2Cu3O6+x 45, and cobalt oxide La2−xSrxCoO4 46, spin excitations exhibit hourglass-like dispersions that can be well- described by localized moments in an inhomogeneous spin-charge separated stripe phase47, although the Fermi surface nesting explana- tion also cannot be totally ruled out48. For intermediate electron cor- relatedmaterials such as ironpnictides49, both Fermi surfacenestingof itinerant electrons and localized moments contribute to spin excitations50. To understand the microscopic origin of incommensurate mag- netic order in FeGe, we carried out inelastic neutron scattering experiments to measure temperature and magnetic field dependent incommensurate order and the associated spin excitations. If the spin structure of FeGe follows the local moment picture, the canted Jc1 Jc2 Fe Ge ba e DMc2 L (r. l. u.) H (r . l . u .) 0.5 1 1 0 c A T >Tcanting qIC [H 0] [0 K] a b d T < Tcanting T < Tcanting f g h T >Tcanting T < Tcanting α kx(Å -1) k z (Å -1 ) 0 -0 .5 0. 5 0-0.5 0.5 0-0.5 0.5 0-0.5 0.5 maj min dxy+dx2-y2 dxz+dyz dz2 qIC [0 K] [H 0] [0 0 L] A [0 0 1/2] Γ qIC M L K H M L M L M L i j a b c φ k Fe a c Jc1 J1 DMc2 DM’ DM’ T DM T c2 Fig. 1 | Crystal,magnetic, and electronic structures of FeGe. aThemagnetic unit cell of FeGe in the A-type AFM state, (b) The incommensurate double cone AFM structure with a canting angle α, showing interlayer nearest neighbor exchange Jc1, next-nearest neighbor exchange Jc2, and possible interlayer DM interaction DMc2. The spiral spin structure in b and c are speculations from previous literature30,31. c The kagome Fe layer in the incommensurate phase with canted spins at an azimuth angle ϕ. Here the CDW-induced lattice distortion is not pictured. d The first Brillouin zone of pristine FeGe (symmetric phase above TN) with high- symmetry points. The positions of incommensurate magnetic Bragg peaks are marked as green dots. The shaded area corresponds to the reciprocal space shown in panels h–j. All slices and cuts in this work are integrated between [H,H] = [−0.03, 0.03] r.l.u., [−K,K] = [−0.05, 0.05] r.l.u.. (e-g) Schematics of the neutron magnetic Bragg peak intensity at (e) T > TCanting around (1, 0, 0.5), (f) T < TCanting around (0, 0, 0.5), and (g) T < TCanting around (1, 0, 0.5). h–j Orbital-selective DFT band structure calculations in the kx-kz plane denoted by the shaded area in d, the respective M and L points are shown using blue and cyan dots, respectively. The nesting wavevector qIC (green double arrow) in i corresponds to the incommen- surate magnetic Bragg peak position shown in d, f, g. k Schematics of the effective DM vector on the A-type AFM spins bonded by DMc2, showing zero net contribution. Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 2 magnetic structure should be stabilized by the competition between the nearest interlayer interaction Jc1 and the next-nearest layer Jc2 along the c-axis (Fig. 1b)31. On the other hand, incommensurate magnetic peaks could also be spin density wave-like modulations arising from electron-hole Fermi surface nesting at q = qIC, analogous to the colli- near magnetic order in iron pnictides50. Since a double-cone canted AFM structure as observed in FeGe is not supported by a reasonable Heisenberg Hamiltonian with Dzyaloshinskii-Moriya (DM) interactions and magnetic anisotropy within the centrosymmetric kagome lattice structure of FeGe (Fig. 1k)51, a determination of the microscopic origin of the incommensurate peaks in FeGe will shed new light on our understanding of the magnetic structure and interactions in magnetic kagome lattice materials. Here we report neutron scattering studies of the magnetic structure and low-energy spin excitations of FeGe as a function of temperature and in-planemagneticfield along the [H, −H, 0] direction. We confirm that an in-plane field of up to 11 T suppresses the incom- mensurate magnetic elastic scattering at (0, 0, ± δ) but keeping the incommensurability δ unchanged30,31. In the canted AFM phase (T < TCanting), gapless spin excitations stem from incommensurate wave vectors qIC = (L ± δ) and merge with increasing energy into gap- ped spin waves from A-type AFM order at L = 0.5. Surprisingly, incommensurate gapless spin excitations persist to temperatures well above TCanting and TCDW, where static AFMorder is commensurate, and vanish only around TN. The spin gap at commensurate L = 0.5 increases with increasing temperature, contrary to the expectation of spin-orbit coupling induced anisotropy gap but consistent with the increase in the magnitude of c-axis magnetic field needed to induce spin-flop transition30–32,52. By carefully fitting the overall spin excitation disper- sions along the L direction in the A-type and canted AFM phases using the linear spinwave theory (LSWT) within a Heisenberg Hamiltonian at temperatures across TCanting40,41, we find that spin waves can be well described by the NN c-axis exchange coupling and the incommensu- rate magnetic peaks below TCanting cannot arise from the proposed double-cone canted AFM structure30,31. Instead, the incommensurate peaks are likely due to Fermi surface nesting, arising from flat elec- tronic bands near the Fermi level around TN. On cooling below TCDW, the opening of electronic gaps near Van Hove singularities further modifies the incommensurate peaks, setting up magnetic critical scattering associated with TCanting. For comparison, low-energy spin waves from commensurate A-type AFM order can be well understood by a local moment Heisenberg Hamiltonian. Therefore, low- temperature magnetic phases of FeGe arise from competition amongst the local moment exchange, magnetic anisotropy, and spin density wave interactions from Fermi surface nesting, most likely due to flat electronic bands near the Fermi level around TN and associated electron correlation effects. Experimental results We first consider spin excitations in the commensurate A-type AFM phase at a temperature well above the incommensurate AFM and CDW-ordered phases (T > TCDW > TCanting). Figure 2a, c show the overall spin wave spectrum along the [0, 0, L] direction and low- energy spin excitations near (0,0,0.5), respectively, at T = 120 K. While the overall spin wave spectrum has a band top of ~ 22meV (Fig. 2a), the low-energy excitations reveal two components: a commensurate spin excitation with high intensity gapped around 1meV, and low-intensity gapless spin excitations centered at Q = (0, 0, 0.5 ± δ), where δ = 0.04 r.l.u. is the ordering wave vectors of incommensurate peaks below TCanting (Fig. 2c, f). The observed spin gap at commensurate wavevector (0, 0, 0.5) in FeGe is the single-ion anisotropy gap, its value of ~ 1meV is similar to the ani- sotropy gap of ~1.5 meV at (0, 0, 0.5) in spin waves of FeSn, where there are no incommensurate spin excitations around Q = (0, 0, 0.5 ± δ)24,25. Figure 2b shows the overall spin wave spectrum along the [0, 0, L] direction at 8 K, showing slight hard- ening of the zone boundary magnon. Since previous neutron diffraction experiments reveal that an in- plane magnetic field can dramatically change the magnetic intensity of incommensurate peaks and modify magnetic structure30,31, it will be interesting to determine the temperature and in-plane magnetic field dependence of the low-energy spin excitations. Figure 3a, b showQ − E maps of low-energy spin excitations at 70K and base (2 K), respectively, with zero applied field. Compared with the 120K case (Fig. 2c), spin excitations at 70K (Fig. 3a) and 2K (Fig. 3b) show similar patterns with gapped commensurate and gapless incommensurate spin excitations. However, the spin gap at commensurate wavevector L =0.5 reduces with decreasing temperature, contrary to the expected behavior of an anisotropy gap. By cutting the gapped excitations along the energy at L =0.5 ±0.01, we can avoid incommensurate spin excitations and quantitatively determine the temperature dependence of the com- mensurate anisotropy gap sizes as shown in data points of Fig. 3d–f. We use the equation I = I0 +A � Erfc ½ðE � EgapÞ=σ�=½1� expð�E=kBTÞ� to fit the energy cuts, where Erfc(x) is the error function simulating finite instrumental resolution, Egap is estimated gap value, kB is the Boltzmann constant, and the denominator serves as the Bose population factor. 3.0 2.5 2.0 1.5 1.0 0.5 0.0 0.70.60.50.40.3 S (Q ,ω ) ( ar b. u ni t) 30 25 20 15 10 5 0 E (m eV ) 3.0 2.5 2.0 1.5 1.0 0.5 0.0 [0,0,L] (r. l. u.) 3.0 2.5 2.0 1.5 1.0 0.5 0.0 0.70.60.50.40.3 T=120K LSWT, Jc1 only LSWT, Jc1 + Jc2 c b e d 2.0 1.6 1.2 0.4 0.0 0.8 [0,0,0.5+δ] (r. l. u.)[0,0,L] (r. l. u.) -0.05 0.050 f Double peak fits Single peak fits T=120K dE=0.1meV H ig h Lo w HYSPEC 30 25 20 15 10 5 0 -0.6-0.81-1.2-1.4 Jc1 only Jc1+Jc2 T=120K a ARCS T=8KARCS -0.6-0.81-1.2-1.4 Jc1 only In te ns ity (a rb . u ni t) H ig h Lo w Fig. 2 | Spin excitation spectrum along the [0,0, L] direction. a Overall spin waves along the [0, 0, L] direction at 120K. The white and yellow lines are the best LSWT fit using Jc1-only model and the Jc1-Jc2 model respectively. The white data points are constant-Q cuts used forfitting.b Samespinwavedispersionas (a) at 8 K. The band top is ~ 10% higher than that in a. The fitting line assumes the spins are along the c-axis. c Low-energy spin excitations at 120K and 0 T, showing a gapped commensurate part and a gapless incommensurate part. d, e The low-energy neutron spectra for the Jc1-Jc2 model and the Jc1 only model, respectively. f Constant energy fits of the intensity shown in (c), with double Gaussian peak fitting at lower energy and single Gaussian fitting at higher energy. The horizontal error bars in f are uncertainties of peak positions obtained from single and double peak fits. Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 3 The spin gap values extracted at 120K, 70K, and 2K are Egap = 1.16 ±0.02, 0.99 ±0.03, and 0.86 ±0.06meV, respectively. For the 120K data, we can calculate the single-ion anisotropy Dz= −0.015meV in the Jc1-only model from the LSWT formula Egap = 2S ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi 2Jc1 Dz �� ��q , where we assume Fe spin S= 1. With decreasing temperature, the reduction of the anisotropy gap is comparable with the decrease of the critical c-axis aligned magnetic field needed to induce a spin-flop transition27,32. Figure3c shows the impactof an 11-T in- plane magnetic field on the Q-E map of Fig. 3b. In addition to sup- pressing quasi-elastic scattering near the incommensurate wave vec- tors, thefield enhances the spin gap from Egap =0.86meVat0-T (Fig. 3f) to 1.26meV at 11-T (Fig. 3g). To understand the impact of TCanting, TCDW, and TN on the low- energy incommensurate spin excitations, we summarize in Fig. 4 the temperature evolution of the incommensurate spin excitations along the [0, 0, L] direction. The incommensurate spin excitations survive up to at least 350 K (Fig. 4a–e), then merge with the commensurate spin waves around TN = 400K (Fig. 4f, g) as the latter collapse to zero energy. Similar to Fig. 3d–g, we extract the commensurate gap sizes (Egap) up to 350K (Fig. 3h) andfind that Egap is proportional to the spin- flop field HSF times the ordered moment M (the red line in Fig. 4i)32. This is expected because a spin-flop transition occurs when the Zee- manenergy formagnons gμBH exceeds the anisotropy gapenergy Egap. The temperature dependence of the anisotropy is also consistent with previous torque measurements29. The dependence of the magnetic anisotropy on temperature and field modulates the spin wave spec- trum by adjusting the spin gap while maintaining both the magnon band structure and the spectral weight. If both commensurate and incommensurate excitations originate from the same c-axis double-cone AFM structure, we would expect both to follow theBosepopulation factorwith increasing temperature, as our muon spin rotation experiments find above 90% magnetic ordered volume fraction below 200K (unpublished). Figure 5a, b compare the temperature dependence of spin excitations along the [0, 0, L] direction at different energies. While E = 1.5meV excitations at the commensurate position follow the Bose population factor I / 1=½1� expð�E=kBTÞ� from 2K to 120K (Fig. 5b), E = 0.6meV spin excitations at incommensurate wave vectors first increase in intensity on warming from 2K to 70K, and then decrease intensity from70K to 120K (Fig. 5a). In addition, an 11-T in-plane magnetic field dramatically suppresses the incommensurate magnetic Bragg peaks (Fig. 5c) and reduces incommensurate spin excitations (Fig. 5d), but has limited impact for commensurate spin excitations at E = 1.5meV (Fig. 5d).With increasing temperature from 4K, the intensity of the incommensurate excitations initially increases, reaching a broad plateau around TCanting, E (m eV ) In te ns ity (a rb . u ni t) H ig h Lo w 0 100 200 300 0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 E ga p ( m eV ) T (K) HYSPEC Pelican Teng et al. 2.0 1.5 1.0 0.5 0.0 T=120K T=250K 0.70.60.50.40.3 T=350K T=400K [0, 0, L] (r. l. u.) 0.70.60.50.40.3 2.0 1.5 1.0 0.5 0.0 a c e f Pelican Pelican Pelican Pelican i 0.5 1 1.5 2 0 1 2 3 4 5 E (meV) N or m al iz ed S (Q ,ω ) ( ar b. u ni t) 350K 300K 250K 200K 120K h T=200KPelican T=300KPelican T=410KPelican b d g2.0 1.5 1.0 0.5 0.0 2.0 1.5 1.0 0.5 0.0 2.0 1.5 1.0 0.5 0.0 [0, 0, L] (r. l. u.) Data Fit gμ BH SF M /M m ax (m eV ) g=2.24 H=0T Fig. 4 | Low-energy spin excitations aboveTCDW. a–g Low-energy spin excitations at 120K, 200K, 250K, 300K, 350K, 400K, and 410K, respectively. The color bar is scaled with a Bose factor at 1meV for different temperatures. h constant-Q (Q = (0, 0, 0.5 ± 0.01)) cuts from spectra shown in a–e, with fitting curves specified in the main text. i Fitted gap sizes (Egap) as a function of temperature, over-plotted with the calculated gap size from the spin-flop field (HSF) and ordered magnetic moment (M) from32. The vertical error bars in h are statistical errors of 1 standard deviation. 3.0 2.5 2.0 1.5 1.0 0.5 0.0 E (m eV ) 3.0 2.5 2.0 1.5 1.0 0.5 0.0 0 5 10 15 Data Fit 0 2 4 6 8 10 0 0.5 1 1.5 2 2.5 3 0 0.5 1 1.5 2 2.5 Egap = 1.16meV Egap = 0.985meV Egap = 0.857meV E (meV) In te ns ity (a rb . u ni t) a b d e f 3.0 2.5 2.0 1.5 1.0 0.5 0.0 [0, 0, L] (r. l. u.) 0.70.60.50.40.3 c H ig h Lo w 0 0.5 1 1.5 2 2.5 g T=2K H=11T Egap = 1.26meV T=2K H=0T T=70K H=0T T=120K H=0T T=70K H=0T T=2K H=0T T=2K H=11T HYSPEC HYSPEC HYSPEC Fig. 3 | Temperature and in-plane magnetic field dependence of spin excita- tions. a–c Low-energy spin excitations at (70 K, 0 T), (2 K, 0 T), and (2 K, 11 T), respectively. d–g the constant-Q (Q = (0, 0, 0.5 ± 0.01)) cuts at (120K, 0 T), (70K, 0 T), (2 K, 0 T), and (2K, 11 T). The vertical error bars in d–g are statistical errors of 1 standard deviation. Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 4 then subsequently decreases but does not disappear completely (Fig. 5e, g). The temperature range of the plateau between 35 to 75 K indicates a crossover region with physical processes that are not fully understood31. The incommensurability δ is weakly temperature dependent from4K to 350K (Fig. 5f). Figure 5g compares temperature dependence of the incommensurate and commensurate spin excita- tions at 0 and 11-T in-plane field. With increasing temperature, incommensurate spin excitations at 0.6meV show a broad peak around TCanting for both 0 and 11-T in-plane field (open circles in Fig. 5g). More importantly, this critical scattering-like peak has a clear kink at TCDW, and follows the Bose factor for temperatures up to T = 250K. This indicates that the CDW phase transition plays an important role in the formation of the eventual static incommensurate order. In contrast, the commensurate spin wave intensity at 1.5meV generally follows the Bose factor throughout the temperature range of interest (green crosses in Fig. 5g), consistentwith the spinwavepicture since the [0, 0, L] dispersion does not change dramatically with tem- perature (Fig. 2a, b). This discrepant temperature dependence sug- gests that these two spin excitations come from different origins. Discussion From previous experiments and calculations on the electronic and magnetic structures of FeGe34, the process of AFM phase transition at TN can be thought of as follows. At some temperatures above TN, the paramagnetic flat bands split into spin-majority and spin-minority bands, which localizes magnetic moments with interplane AFM cou- plings from the direct exchange and/or the RKKY interactions. These interplane interactions between localized spins stabilize the A-type AFM magnetic order below TN. However, this picture fails to explain the incommensurate phase in FeGe. In the local moment picture, the double cone AFM structure can arise from competition between the c- axis magnetic exchange and single-ion anisotropy energies31. Assum- ing that the centrosymmetric kagome lattice symmetry of a pristine FeGe is preserved below TN, the DM interactions between the inter- layer Fe atoms should cancel each other and have zero effect on the spin excitations (Fig. 1k)51. Therefore, spin waves along the [0, 0, L] direction in this temperature regime should allow an accurate deter- mination of the NN (Jc1) and next-nearest neighbor (NNN) layer (Jc2) magnetic exchange couplings along the c-axis (Fig. 1b) using LSWT. To understand spin waves of FeGe using local exchange interactions, we consider a Heisenberg Hamiltonian H0 = X JijSi � Sj + X i Dz ðSzi Þ 2, ð1Þ where Jij indicates magnetic exchange interaction between ith and jth Fe atoms, Si (Sj) is the local spin at i (j) site, andDz stands for single-ion magnetic anisotropy. Since the FM in-plane spin exchange couplings34 have no effect on spin wave dispersion along the c-axis (L direction in reciprocal space), we fit the c-axis spin wave dispersion with out-of- plane magnetic exchange couplings and single-ion magnetic aniso- tropy.Within the local exchange picture, if Jc1 and Jc2 are both AFMand satisfy Jc1=Jc2 = � 4 cosð2πqICÞ=3:874, it is possible to have a double cone (canted) AFM structure when exchange energy reduction in the canted phase overcomes the magnetic anisotropy energy31. For the canting angle α < 90∘ in the double cone AFM structure (Fig. 1b), one also needs to consider higher-order magnetic anisotropy terms31. Assuming that the incommensurate peaks arise from this Jc1 − Jc2 relation, one can fit the spin wave spectra in Fig. 2b, c using LSWT41. Compared to pure Jc1 fits with Jc2 = 0 (white solid line in Fig. 2a), the Jc1 − Jc2 model is worse in reproducing both the overall spin wave spectrum as well as its low-energy part (Table 1, yellow solid line in Fig. 2a, d). Both the dispersion and intensity of the low-energy incommensurate spin excitations in Fig. 2c arenot compatiblewith the Jc1 − Jc2 model, indicating that the local moment picture is not the underlying mechanism for the canted phase transition below TCanting. LSWT fits to spin wave dispersion at 8 K reveal similar behavior (white solid line in Fig. 2b). Note that Jc1 and Jc2 in previous reports are -1 0 1 2 3 4 5 Base 70K 120K -2 0 2 4 6 8 10 12 14 16 0.5 0.650.450.40.35 [0,0,L] (r. l. u.) 0.60.550.5 0.650.450.40.35 0.60.55 E=[0.5, 0.7]meV E=[1.4, 1.6]meV c ba S (Q ,E ) ( ar b. u ni t) -1 0 1 2 3 4 5 6 7 0T 2T 11T 0.5 0.650.450.40.35 0.60.55 T = 4K H = 0T H = 0T E=[-0.3, 0.3]meV [0,0,L] (r. l. u.) 11T 0T d 0.5 0.650.450.40.35 0.60.55 0 1 2 3 E=[0.5, 0.7]meV E=[1.4, 1.6]meV 70K 120K T (K) HYSPEC HYSPEC HYSPEC HYSPEC 0 50 100 150 200 250 300 350 f HYSPEC Pelican δ (r. l. u .) 0 0.04 0.06 0.02 E=[0.4, 0.6]meV IIC,0T (HYS) IIC,11T (×1.7,HYS) IIC,0T (Pelican) 0.6meV g TCantingTT 0 50 100 150 200 250 0 10 20 30 40 S (Q ,E ) ( ar b. u ni t) 50 L=[0.4, 0.6]r. l. u. TCDWTT 1.5meV IC,0T (HYS) IC,0T (Pelican) T (K) 50 150 250 350 0.2 0.4 0.6 0.8 1.0 1.2 E (m eV ) 0T(Pelican) L=[0.4, 0.6]r. l. u. e H ig h Lo w S (Q ,E ) (a rb . u ni t) T (K) Bose Factors BFE Fig. 5 | Temperature and field dependence of low-energy spin structure and excitations. a, b Temperature dependence of the incommensurate (0.6meV) and commensurate (1.5meV) spin excitations, respectively. The dashed lines in a, b are the estimated intensities at 70K and 120K by multiplying the base temperature intensity with a Bose factor. c In-plane field dependence of the incommensurate magneticBraggpeaks at 4 K (base temperature).d In-planefielddependenceof the incommensurate and commensurate excitations at base temperature. The vertical error bars in a–d are propagation errors obtained by subtracting the background scattering. e Temperature and energy dependencies of the neutron intensity at L = [0.4, 0.6]. The lower intensity above 1.1meV is a result of limited detector coverage. Thewhite box shows the integration and plot range forg. f Temperature dependence of the incommensurability δ at E =0.5meV. g Temperature depen- dence of the 0.6mmeV (circles) and 1.5meV(crosses) spin excitations under 0T and 11T in-plane field. The black solid and dashed lines show the Bose factor at 0.6meV and 1.5meV, respectively. The gray vertical dashed linesmark TCanting and TCDW. The vertical error bars in g are statistical errors of 1 standard deviation. Table 1 | Fitting parameters andcoefficient of determination r2 for the LSWT fitting on [0 0 L] spin wave data at 120K using the two models mentioned in the text Model Jc1 (meV) Jc2 (meV) Dz (meV) r2 Jc1-only 11.3 ± 0.4 0 −0.015 ± 0.001 6.9 Jc1 − Jc2 25.9 ± 2.7 6.7 ± 0.7 −0.018 ± 0.002 60.5 The fitting parameter is used to generate the calculation results in Figs. 2a, d, and e. Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 5 estimated to be 3.5meV and 0.9meV, respectively31. These values are dramatically different from Heisenberg fits to the c-axis dispersion shown in Fig. 2a. In the above discussion, we assumed that the inversion symmetries along the c-axis in the crystal structure of FeGe are preserved below TCDW (Fig. 1k), and therefore there is no net contribution of DM interactions to the double cone magnetic structure51. However, recent X-ray diffraction experiments35 indi- cate that the Fe atoms form charge dimers along the c-axis as well as moving in the ab-plane in the CDW phase. This induces asymmetry in the Fe local environment by introducing unequal bond lengths with its upper and lower neighbors, and will pre- sumably change the interlayer exchange coupling and the mag- netic anisotropy (Fig. 1b, and Extended Fig. S1). Due to the distance change of the diagonal bonds between interlayer Fe atoms (Fig. 1k), their respective DMc2 interactions are not in bal- ance with each other and will provide a non-zero net contribution to the spin Hamiltonian. In addition, the symmetry breaking induced by the CDW phase may introduce odd-parity magnetic anisotropy terms into the system, as suggested by a precursory enhancement of magnetic susceptibility just before the spin-flop transition below TCDW with a c-axis magnetic field32. This addi- tional magnetic anisotropy brought by the CDW makes it possible to achieve a canting phase with the canting angle α < 90∘. Never- theless, since the precise crystalline lattice structure below TCDW is unknown, it is difficult to determine the impact of CDW order on the incommensurate magnetic scattering below TCanting. However, regardless of the role of CDW order on the incom- mensurate magnetic order, it cannot be the origin of the incommen- surability, as incommensurate spin excitations associated with the eventual static magnetic order below TCanting are present at tempera- tures well above TCDW of ~ 110K (Figs. 2–5). These results suggest that the origin of incommensurate magnetic order has no direct connec- tion to CDW phase-associated lattice distortion and DM interactions which, in this case, can only serve for tuning the canting angle51. Since the intensity and dispersion of the incommensurate spin excitations are not compatible with the gapped spin waves, we conclude that the local moment double cone magnetic structure suggested originally to explain the observed incommensurate order is problematic. Instead, our data suggest that the Fermi surface nesting along the L-direction between spinmajority andminority bands creates a spin density wave- like order within the commensurate A-type AFM phase analogous to the collinear magnetic order in iron pnictides50. To check this possi- bility, we performed DFT calculations on the ky-kz plane to extract the nesting susceptibility χ(q) in the AFM-ordered state, where ferro- magnetismwithin each Fe layer should split the degenerate electronic bands near the Fermi level into the spin-majority and spin-minority electronicbandswith different orbital characteristics42. Comparing the possible spin-majority/spin-minority pair nesting excitations for the dxy +dx2�y2 (Fig. 1h), dxz+ dyz (Fig. 1i), and dz2 (Fig. 1j) orbitals, we find that the wave vectors of the observed incommensurate spin excita- tions most likely correspond to the narrow electronic bands with dxz + dyz orbital characters (Fig. 1i). An advantage of the itinerant picture is that it does not require specific interlayer magnetic or electronic interactions to achieve the incommensurate phase. According to Figs. 1h–j, the nesting suscept- ibility is mostly enhanced by the in-plane flattish band structure from the kagome geometry, while the out-of-plane electron dispersion only selects the most favorable qIC. Specifically, the fact that the IC excita- tion intensity increases after the CDW phase transition strongly sug- gests that the IC order is closely related to the Fermi surface nesting between the Van Hove singularities, which the CDW phase transition mostly modifies. For comparison, A-type AFM order in FeGe below TN is consistent with the local moment Heisenberg Hamiltonian. The property of the combined itinerant and local picture for FeGemakes it possible for the application to other kagome systems without recon- sidering the detailed interatomic magnetic interactions, and can potentially explain the universality of the incommensurate phase in these kagome metals. If the itinerant electron picture is correct, then the incommensurate phase observed in FeGe and related kagome metals are examples of spin density waves originating from the in- plane strong electron correlations but expressed in the interlayer direction possibly involving RKKY interactions. It will be interesting to determine the spin configurations of the incommensurate phase using neutron polarization analysis where the moment direction of the spin density wave can be conclusively determined53. Furthermore, one would expect the sizes of the ordered moments themselves can fluc- tuate, giving rise to longitudinal spin excitations that can be detected by neutron polarization analysis54. Our results demonstrate that the incommensurate magnetic phase in FeGe originates neither from the localized exchange interaction nor from theCDWphase transition, but arises from the nested Fermi surfaces of itinerant electrons, possibly involving flat bands near the Fermi level around TN and associated electron correlation effects55. Methods Single crystal growth and the reciprocal lattice High-quality single crystals of FeGe were grown by the chemical vapor transportmethod32,56. The crystals are typically 2 × 2 × 1mm3 in size and 15mg inmass. Pristine FeGe belongs to the hexagonal space group P6/ mmm (191) with lattice constant a = b = 4.99 Å, c = 4.05 Å. The A-type AFM magnetic structure doubles the c-axis as shown in Fig. 1a. How- ever, here we still use the chemical lattice structure for the reciprocal lattice vectors. In this notation, the momentum transfer Q =Ha* +Kb* + Lc* is denoted as (H,K, L) in reciprocal lattice units (r.l.u.) (Fig. 1c, d). The high symmetry points Γ, M, K, A, L, H in the reciprocal space are specified in Fig. 1d. Neutron scattering Inelastic neutron scattering experiments were performed at the ARCS57 (Fig. 2a, b) and HYSPEC58 (for all other figures with neutron data) neutron time-of-flight spectrometers at the Spallation Neutron Source (SNS), OakRidgeNational Laboratory (ORNL) on ~ 0.9 grams of single crystal sample aligned in the [H,H, L] scattering plane. Fig- ure S1a, b show the Bragg peaks of the co-aligned sample. The sample mosaicity perpendicular to the [0, 0, L] is 0.92∘ in full width at half maximum (FWHM). The Laue pattern of every sample is consistent with the hexagonal structure of FeGe (Fig. S1b), and magnetic sus- ceptibilitymeasurements on selective samples show consistent results compared to previous reports27,32. The incommensurate mag- netic Bragg peak and excitations are resolution limited, indicating that the homogeneity of the composite sample is good. The incident neu- tron energies for the ARCS and HYSPEC experiments are Ei = 45meV and 9meV, respectively. Additionally, experiments with the same sample and geometry were carried out at the Pelican spectrometer located in ANSTO, Australia59. The elastic line resolution (in full width at half maximum) of the ARCS, HYSPEC, and Pelican experiments are 2.0meV, 0.33meV, and 0.13meV, respectively. The experiments were performed using rotation sample scanning. The neutron data were analyzed and integrated using the DAVE software60. To calculate the neutron intensity from LSWT, we utilized the SPINW software package for the magnon dispersion and instrumental resolution convolution61. For the HYSPEC experiment, a vertical magnet was used to apply in- plane magnetic fields, and we subtracted all HYSPEC data by an empty magnet scan with no sample in the beam. The Pelican data is also subtracted by background scans with no sample. All background- subtracted neutron data are labeled with unit “S(Q,ω)”, while all un- subtracted data are labeled with unit “Intensity”. To emphasize rele- vant features, all data displayed are smoothed with a level-3 Gouraud shading. Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 6 Incommensurate spin structure and excitations Figure S2 shows the detailed cuts of magnetic excitations shown in Figs. 2f and 4f of themain text. All the data are integrated according to the range specified in themain text. Figure S3a shows the temperature dependence of the incommensurate magnetic Bragg peaks under an 11-T in-plane field, which is similar to the temperature dependence of the ICBragg peak at0T. The temperature dependence of the (0, 0, 0.5) peakmostly follows theCDW temperaturedependence at0T, but is on top of a temperature-independent magnetic background from in- plane moments induced by the 11T field (Fig. S3b). Figure S3c shows the temperature dependence of the imaginary part of the dynamic susceptibility χ″(E) at the incommensurate position across TCanting, where Fig. S3d is the χ″ at 1.5meV as a function of [0, 0, L] at different temperatures. Combined with Fig. 4 in the main text, we further con- firm that while the commensurate excitations above the spin gap fol- low the Bose factor across TCanting, the incommensurate excitations go through a peak around 70K with additional change at TCDW (Fig. 5g). Figure S4 shows spin excitations at 2 K, 70K, and 120K under an in- plane field of 2-T, not much different from the 0-T data. Figure S5 shows the overall temperature dependence of the low-energy spin excitations from base to 410 K used for plotting Fig. 4e, f in the main text, with adaptive color bars. Density functional theory calculations DFT calculations were performed with the Vienna ab initio Simula- tion Package (VASP)62. The generalized gradient approximation parameterized by Perdew-Burke-Ernzerhof63 is used for the electron- electron exchange interaction throughout. The FeGe structure was fully relaxed until the maximal remaining force on atoms is no larger than 1meV/Å. An energy cutoff of 350 eV is used for the plane wave basis set. k-meshes of 12 × 12 × 16 and 12 × 12 × 8 are employed for sampling the Brillouin zones of the FM and AFMphases, respectively. All Fermi-surface-related properties of both the FM and AFM phases are calculated with the tight-binding Hamiltonian obtained from the Wannier 90 software64 interfaced with VASP, where the Fe d and Ge p orbital are considered. Notice that in Fig. 1h–j, the Fermi surfaces are for the FM phase without spin-orbital coupling. The Lindhard sus- ceptibility for the Fermi surface nesting is calculated anddisplayed in Fig. S6. Calculations from FM without SOC and AFM with SOC give qualitatively the same results in the band structure and spin sus- ceptibility, known that AFM has a folded band structure and SOC is relatively weak in FeGe. However, the spin susceptibility calculated from the FM structure gives directly the correct nesting vector while that from AFM gives a folded nesting vector, because the AFM structure has a double unit cell along the c axis. Although these two q vectors are physically equivalent, it ismore insightful to demonstrate qIC from the FM structure. The nesting susceptibility of the AFM phase with SOC at qIC is at maximum apart from that around the AFM wavevector (Fig. S6d), which supports the nesting picture as the reason for the IC phase. The localized spin model for the incommensurate phase Here we review the localized moment picture by Beckman et al.27 to understand the incommensurate phase. In the localized spin model, the Hamiltonian consists of Heisenberg exchange and anisotropy. The related terms are: H = X j Hj , ð2Þ Hj = Jc1ðSj � Sj + 1Þ+ Jc2ðSj � Sj + 2Þ+DzS 2 jz : ð3Þ Here j is the atom layer index, Jc1 and Jc2 are defined in Fig. 1 of themain text, and Dz is the single-ion anisotropy. Tominimize the Hamiltonian, we first assume the spin structure to be: Sjx = S cosð2πjqICÞ sinα, Sjy = S sinð2πjqICÞ sinα, Sjz = S cosðjπÞ cosα: ð4Þ Then equation (3) turns into: Hj = ðDz � Jc1 + Jc2ÞS2cos2α + ½ Jc1 cosð2πqIC Þ+ Jc2 cosð4πqIC Þ�S2sin2α: ð5Þ Here note that Hj is not j-dependent, therefore one can minimize the totalHamiltonianbyminimizingHj. Taking partial derivative of (5)with respect to qIC and α, one gets ∂Hj ∂qIC = � 2πS2sin2α½ Jc1 sinð2πqICÞ � 2Jc2 sinð4πqICÞ�, ð6Þ ∂Hj ∂α = 2S2 sinα cosα½�Dz + Jc1ðcosð2πqICÞ+ 1Þ+ Jc2ðcosð4πqICÞ � 1Þ�: ð7Þ From (6), we see that when the canting angle α is finite, the incommensurability qIC is not dependent on the canting angle, and is only a function of the Jc1/Jc2 ratio, as stated in the main text. For qIC = 0.46, we have Jc1/Jc2 = 3.874. In ref. 27, Beckman et al. deduce from susceptibility measurements that the Jc1 = 3.5meV and Jc2 = 0.9meV. These values are much different from exchange couplings Jc1 and Jc2 determined from the c-axis spin wave dispersion of FeGe (Fig. 2b). However, from equation (7), we see that only by setting α = 0 or 90∘, one can achieve the lowest energy for the spin Hamilto- nian. As a consequence, an α = 18∘ magnetic structure is pro- hibited in this model. To understand the observed incommensurate magnetic structure, the spin Hamiltonian must be adjusted. In ref. 27, Beckman et al. assumed a higher-order anisotropy D4S 4 z term, which turns Eq. (7) into ∂Hj ∂α =2S2 sinα cosα½�Dz � 2D4S 2cos2α + Jc1ðcosð2πqIC Þ+ 1Þ+ Jc2ðcosð4πqICÞ � 1Þ�: ð8Þ Since the higher-order anisotropy put a term with α into the square bracket of equation (7), one can expect a canting angle that is not 0 or 90∘. By setting the part in the square bracket equal to zero, putting together Jc1/Jc2 = 3.874, α = 18∘, qIC = 0.46, and S = 1, one will have 1:809D4 +Dz +0:005123Jc1 = 0: ð9Þ If Dz and Jc1 are known, D4 can be calculated accordingly. Note here only when D4 > 0 (favoring an easy plane) will the Hamiltonian be convex with respect to α. Therefore, it requires ∣Jc1∣ < 195.2∣Dz∣ for positive AFM Jc1 and negative Dz favoring an easy axis. The previous model gives a minimum parameter set necessary to induce an incommensurate canting phase. It is possible to have other exchange interactions, such as off-diagonal interactions as well as biquadratic interactions. Here wewill give amore complete analysis of the possible exchange interactions: First, we consider bilinear exchange interactions. Intralayer interactions do not contribute to the [0, 0, L] spectrum, sowewill only discuss interlayer exchanges. For off- diagonal interactions with SiαJαβSjβ, only when {α, β}∈ {x, y} does the matrix element Jαβ take effect in LSWT for collinear AFM magnetic structure, because any bilinear term containing only one Sz will only have odd numbers of magnon operators and should be omitted in Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 7 LSWT. This gives the possible configuration Jαβ as A D+ E 0 D� E B 0 0 0 C 2 4 3 5 Where {A, B,C} is the anisotropic exchange, D is the strength of sym- metric off-diagonal exchange, and E is the antisymmetric exchange, i.e., the DM interactions. In LSWT, the anisotropic exchange has the same effect as single-ion anisotropy when written in bilinear spin operators in k-space, and will only lift the whole spin wave spectra by a certain energy depending on the difference between A, B, and C, and will open a gap at the lowest energy. The symmetric off-diagonal exchange will induce the same effect. The DM interaction has no impact on the spin wave spectrum for pristine AFM FeGe as discussed in the main text. For multi-spin interactions, we consider biquadratic exchanges as an example. In the linear approximation, the biquadratic exchange produces the same spin waves, but the effective exchange coupling is modified and proportional to the temperature-dependent ordered spin S2. If this temperature-dependent interaction is con- sidered one of the origins of the incommensurability, then the incommensurability wavevector should also change as a function of temperature, which alternates the ordered spin. Figure 5f in the main text shows the incommensurate wavevector qIC varies from 0.455 to 0.465,meaning the effective Jc1/Jc2 between3.83 and3.91. If biquadratic interactions are the reason for the change of qIC, the relative energy scalewill not be larger than3%of Jc1, and should notbe themain reason for the incommensurability. This argument can also be used to exclude other multi-spin interactions, such as the three-spin interaction in introducing the incommensurate order. Therefore, the Jc1 − Jc2model is a minimum effective model for consistently explaining the incom- mensurability through the whole temperature range. Roles of the DM interaction and additional anisotropy from CDW TheDM interactionworks in a similarway as theHeisenberg exchange. Using equation (4) to calculate the DM energy, we can get HDM j =A? j S 2 sinð2πqICÞsin2α, ð10Þ where A? j is the net DM interaction between the jth and (j + 1)th layers of atoms. In the A-type AFMphase, A? j =0 as shown in Fig. 2a.While the detailed crystalline structureof the CDWphase is unknown, a non-zero A? j will be possible in theCDWphase. Adding equation (10) to equation (5), we can see theHDM j adds up to the second term of the right part in equation (5), which does not change the fact that ∂Hj ∂α can only achieve its lowest energy state at α=0 or 90∘. Although we have to note that in the local exchangepicture, the changeofDM interaction betweenAFM and CDWphase will alternate the incommensurate wavevector qIC, the associated energy scale will be smaller than 3% of Jc1 using the same argument as in biquadratic interactions. According to the recent X-ray diffraction experiments35, one of the most prominent features of the CDW-induced lattice distortion is the movement of Fe and Ge atoms along the c-direction, suggesting a c-axis modulation of the Fe and Ge atoms. If this is the case, the Fe environment will not be mirror symmetric along the c-axis, and odd- parity anisotropy terms (D1Sz, D3S 3 z , etc.) will be present in the Hamil- tonian. The detailed angle dependence of themagnetic anisotropywill require further neutron and magnetometry experiments to resolve. Althoughour inelastic neutron scattering studyof spin excitations in the main text eliminated the possibility that the local exchange interactions, including the DM interaction, can give rise to the incommensurate phase, the aforementioned theory is still valuable. Assuming that the incommensurate phase originates from Fermi sur- face nesting, one can write down a Landau theory with the in-plane moment as the order parameter, and it can generate a canting phase with a certain set of parameters. Even in this case, the exchange interactions and quadratic term of anisotropy will contribute to the quadratic term of the Landau theory, and the higher-order anisotropy will affect its higher-order terms, effectively competing with the Fermi surface nesting and controlling the incommensurate order parameter. Magnetic intensities of the incommensurate phase Figure S2 shows the detailed cuts of magnetic excitations shown in Figs. 2f and 4f of themain text. All the data are integrated according to the range specified in the main text. Figure S3 shows the temperature dependence of the incommensurate magnetic peaks under an 11-T in- plane field. While the incommensurate peak intensity reduces sig- nificantly as shown in Fig. 4c of the main text, its temperature dependence is not changed. The temperature dependence of the (0, 0, 0.5) peak, a combination of the CDW superlattice and AFM peak from the in-plane moment induced by the in-plane magnetic field, mostly follows the CDW temperature dependence (Fig. S3b). Figure S4 shows the spin excitations taken at 2 K, 70K, and 120K under an in- plane field of 2-T, not much different from the 0-T data. Data availability The data that support the plots in this paper and other findings of this study are available from the corresponding author on reasonable request. References 1. Bistritzer, R.&MacDonald, A.H.Moirébands in twisteddouble-layer graphene. Proc. Natl Acad. Sci. USA 108, 12233–12237 (2011). 2. Cao, Y. et al. Unconventional superconductivity in magic-angle graphene superlattices. Nature 556, 43–50 (2018). 3. Cao, Y. et al. Nematicity and competing orders in superconducting magic-angle graphene. Science 372, 264–271 (2021). 4. Jaoui, A. et al. Quantum critical behaviour in magic-angle twisted bilayer graphene. Nat. Phys 18, 633 (2022). 5. Regan, E. C. et al. Mott and generalized Wigner crystal states in WSe2/WS2 moiré superlattices. Nature 579, 359–363 (2020). 6. Xie, Y. et al. Fractional Chern insulators in magic-angle twisted bilayer graphene. Nature 600, 439–442 (2021). 7. Mielke III, C. et al. Time-reversal symmetry-breaking charge order in a kagome superconductor. Nature 602, 245–250 (2022). 8. Tasaki, H. From Nagaoka’s ferromagnetism to flat-band ferro- magnetism and beyond: an introduction to ferromagnetism in the hubbard model. Prog. Theor. Phys. 99, 489–548 (1998). 9. Sutherland, B. Localization of electronicwave functionsdue to local topology. Phys. Rev. B 34, 5208–5211 (1986). 10. Leykam, D., Andreanov, A. & Flach, S. Artificial flat band systems: from latticemodels to experiments.Adv. Phys.: X3, 1473052 (2018). 11. Ghimire, N. J. &Mazin, I. I. Topology and correlations on the kagome lattice. Nat. Mater. 19, 137–138 (2020). 12. Yin, J. X., Lian, B. & Zahid Hasan, M. Topological kagome magnets and superconductors. Nature 612, 647–657 (2022). 13. Tang, E., Mei, J. W. & Wen, X. G. High-temperature fractional quantum hall states. Phys. Rev. Lett. 106, 236802 (2011). 14. Mazin, I. I. et al. Theoretical prediction of a strongly correlated Dirac metal. Nat. Comm. 5, 4261 (2014). 15. Kiesel, M. L., Platt, C. & Thomaly, R. Unconventional fermi surface instabilities in the kagome Hubbard model. Phys. Rev. Lett. 110, 126405 (2013). 16. Ortiz, B. R. et al. CsV3Sb5: a Z2 topological kagome metal with a superconducting ground state. Phys. Rev. Lett. 125, 247002 (2020). 17. Jiang, Y.-X. et al. Unconventional chiral charge order in kagome superconductor KV3Sb5. Nat. Mater. 20, 1353–1357 (2021). 18. Liang, Z. et al. Three-dimensional charge density wave and surface- dependent vortex-core states in a kagome superconductor CsV3Sb5. Phys. Rev. X 11, 031026 (2021). 19. Zhao, H. et al. Cascade of correlated electron states in the kagome superconductor CsV3Sb5. Nature 599, 216–221 (2021). Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 8 20. Chen,H. et al. Roton pair densitywave in a strong-coupling kagome superconductor. Nature 599, 222–228 (2021). 21. Neupert, T., Denner, M. M., Yin, J.-X., Thomale, R. & Hasan, M. Charge order and superconductivity in kagome materials. Nat. Phys. 18, 137–143 (2022). 22. Kang, M. et al. Dirac fermions and flat bands in the ideal kagome metal FeSn. Nat. Mater. 19, 163–169 (2020). 23. Ye, L. et al. Massive Dirac fermions in a ferromagnetic kagome metal. Nature 555, 638–642 (2018). 24. Xie, Y. et al. Spin excitations in metallic kagome lattice FeSn and CoSn. Commun. Phys. 4, 240 (2021). 25. Do, S.-H. et al. Damped Dirac magnon in the metallic kagome antiferromagnet FeSn. Phys. Rev. B 105, L180403 (2022). 26. Ohoyama, T., Kanematsu, K. & Yasukochi, K. A new intermetallic compound FeGe. J. Phys. Soc. Jpn 18, 589–589 (1963). 27. Beckman, O., Carrander, K., Lundgren, L. & Richardson, M. Sus- ceptibility measurements and magnetic ordering of hexagonal FeGe. Phys. Scr. 6, 151–157 (1972). 28. Forsyth, J. F., Wilkinson, C. & Gardner, P. The low-temperature magnetic structure of hexagonal FeGe. J. Phys. F: Met. Phys. 8, 2195 (1978). 29. Gäfvert, U., Lundgren, W. B. & Beckman, O. Crystalline anisotropy energy of uniaxial antiferromagnets evaluated from lowfield torque data. J. Phys. Chem. Solids 38, 1333–1339 (1977). 30. Bernhard, J., Lebech, B. & Beckman, O. Neutron diffraction studies of the low-temperature magnetic structure of hexagonal FeGe. J. Phys. F: Met. Phys. 14, 2379–2393 (1984). 31. Bernhard, J., Lebech, B. & Beckman, O. Magnetic phase diagram of hexagonal FeGe determined by neutron diffraction. J. Phys. F: Met. Phys. 18, 539–552 (1988). 32. Teng, X. et al. Discovery of charge density wave in a kagome lattice antiferromagnet. Nature 609, 490–495 (2022). 33. Yin, J. X. et al. Discovery of charge order and corresponding edge state in kagome magnet FeGe. Phys. Rev. Lett. 129, 166401 (2022). 34. Teng, X. et al. Magnetism and chargedensitywave order in kagome FeGe. Nat. Phys. 19, 814–822 (2023). 35. Miao, H. et al. Signature of spin-phonon coupling driven charge density wave in a kagome magnet. Nat. Commun. 14, 6183 (2023). 36. Mazet, T. et al. Valence change and magnetic order in YbMn6Ge6−xSnx. J. Phys.: Condens. Matter 22, 116005 (2010). 37. Wang,Q. et al. Field-induced topologicalHall effect anddouble-fan spin structure with a c-axis component in the metallic kagome antiferromagnetic compound YMn6Sn6. Phys. Rev. B 103, 014416 (2021). 38. Ghimire, N. J. et al. Competing magnetic phases and fluctuation- driven scalar spin chirality in the kagome metal YMn6Sn6. Sci. Adv. 6, eabe2680 (2020). 39. Venturini, G. et al. Magnetic structure of YMn6Ge6 and room tem- perature magnetic structure of LuMn6Sn6 obtained from neutron diffraction study. J. Alloy. Compd. 200, 51–57 (1993). 40. Heisenberg, W. Zur Theorie des Ferromagnetismus. Z. Physik. 49, 619–636 (1928). 41. Boothroyd, A.T. Principles of Neutron Scattering from Condensed Matter. Ch. 8 (Oxford Press, 2020). 42. Gruner, G. The dynamics of spin-density waves. Rev.Mod. Phys.66, 1 (1994). 43. Tranquada, J.M. et al.Quantummagnetic excitations fromstripes in copper oxide superconductors. Nature 429, 534–538 (2004). 44. Zhu, M. et al. Spin fluctuations associated with the collapse of the pseudogap in a cuprate superconductor. Nat. Phys. 19, 99–105 (2023). 45. Hayden, S. M., Mook, H. A., Dai, P., Perring, T. G. & Doğan, F. The structure of the high-energy spin excitations in a high-transition- temperature superconductor. Nature 429, 531–534 (2004). 46. Boothroyd, A. T., Babkevich, P., Prabhakaran, D. & Freeman, P. G. An hour-glass magnetic spectrum in an insulating, hole-doped anti- ferromagnet. Nature 471, 341–344 (2011). 47. Kivelson, S. A. et al. How to detect fluctuating stripes in the high- temperature superconductors. Rev. Mod. Phys. 75, 1201 (2003). 48. Scalapino, D. J. A common thread: the pairing interaction for unconventional superconductors. Rev. Mod. Phys. 84, 1383 (2012). 49. Fernandes, R. M. et al. Iron pnictides and chalcogenides: a new paradigm for superconductivity. Nature 601, 35–44 (2022). 50. Dai, P., Hu, J. P. & Dagotto, E. Magnetism and its microscopic origin in iron-based high-temperature superconductors. Nat. Phys. 8, 709–718 (2012). 51. Zhou, H., Yan, S., Fan, D., Wang, D. &Wan, X. Magnetic interactions and possible structural distortion in kagome FeGe from first- principles calculations and symmetry analysis. Phys. Rev. B 108, 035138 (2023). 52. Bogdanov, A.N., Zhuravlev, A. V. &Röler,U. K. Spin-flop transition in uniaxial antiferromagnets: Magnetic phases, reorientation effects, and multidomain states. Phys. Rev. B 75, 094425 (2007). 53. Liu, P. et al. In-plane uniaxial pressure-induced out-of-plane anti- ferromagnetic moment and critical fluctuations in BaFe2As2. Nat. Commun. 11, 5728 (2020). 54. Wang, C. et al. Longitudinal spin excitations and magnetic aniso- tropy in antiferromagnetically ordered BaFe2As2. Phys. Rev. X 3, 041036 (2013). 55. Li,M. et al. Dirac cone,flat bandandsaddlepoint in kagomemagnet YMn6Sn6. Nat. Commun. 12, 3129 (2021). 56. Richardson, M. The partial equilibrium diagramof the Fe-Ge system in the range 40–72 at at. % Ge, and the crystallisation of some iron germanides by chemical transport reactions.ActaChem. Scand. 21, 2305–2317 (1967). 57. Abernathy, D. L. et al. Design and operation of the wide angular- range chopper spectrometer ARCS at the Spallation Neutron Source. Rev. Sci. Instrum. 83, 15114 (2012). 58. Winn, B. et al. Recent progress on HYSPEC, and its polarization analysis capabilities. EPJ Web Conf. 83, 03017 (2015). 59. Yu, D. H.,Mole, R. A., Noakes, T., Kennedy, S. &Robinson, R. Pelican- a time of flight cold neutron polarization analysis spectrometer at OPAL. J. Phys. Soc. Jpn 82, SA027 (2013). 60. Azuah, R. T. et al. DAVE: a comprehensive software suite for the reduction, visualization, and analysis of low energy neutron spec- troscopic data. J. Res. Natl Inst. Stand. Technol. 114, 341 (2009). 61. Toth, S. & Lake, B. Linear spin wave theory for single-Q incom- mensurate magnetic structures. J. Phys.: Condens. Matter 27, 166002 (2015). 62. Kresse, G. & Furthmuller, J. Efficiency of ab-initio total energy cal- culations for metals and semiconductors using a plane-wave basis set. Comput. Mater. Sci. 6, 15 (1996). 63. Perdew, J. P., Burke, K. & Ernzerhof, M. Generalized gradient approximation made simple. Phys. Rev. Lett. 77, 3865 (1996). 64. Mostofi, A. A. et al. wannier90: a tool for obtaining maximally- localised Wannier functions. Comput. Phys. Commun. 178, 685 (2008). Acknowledgements The neutron scattering and single-crystal synthesis work at Rice was supported by US NSF-DMR-2100741 and by the Robert A. Welch Foun- dation under grant no. C-1839, respectively (P.D.). M.Y. acknowledges support by the U.S. DOE grant No. DE-SC0021421 and the Robert A. Welch Foundation, Grant No. C-2175. A portion of this research used resources at the Spallation Neutron Source, a DOE Office of Science User Facility operated by Oak Ridge National Laboratory. The access of Pelican instrument at ANSTO (P17255) is gratefully acknowledged. B.Y. acknowledges the financial support by the European Research Council Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 9 (ERC Consolidator Grant “NonlinearTopo”, No. 815869) and the ISF - Personal Research Grant (No. 2932/21). Author contributions P.D. and M.Y. conceived and managed the project. The single-crystal FeGe samples were grown by X.T. and B.G. Neutron scattering experi- ments were carried out by L.C., X.T., B.W., G.G., F.Y., D.H.Y., R.A.M., and analyzedby L.C. DFT calculation is carried out byH.T. and B.Y. The paper was written by L.C. and P.D. with inputs from all coauthors. Competing interests The authors declare no competing interests. Additional information Supplementary information The online version contains supplementary material available at https://doi.org/10.1038/s41467-023-44190-2. Correspondence and requests for materials should be addressed to Pengcheng Dai. Peer review information Nature Communications thanks Andrew Boothroyd, and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. A peer review file is available. Reprints and permissions information is available at http://www.nature.com/reprints Publisher’s note Springer Nature remains neutral with regard to jur- isdictional claims in published maps and institutional affiliations. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/ licenses/by/4.0/. © The Author(s) 2024 Article https://doi.org/10.1038/s41467-023-44190-2 Nature Communications | (2024) 15:1918 10 https://doi.org/10.1038/s41467-023-44190-2 http://www.nature.com/reprints http://creativecommons.org/licenses/by/4.0/ http://creativecommons.org/licenses/by/4.0/ Competing itinerant and local spin interactions in kagome metal�FeGe Experimental results Discussion Methods Single crystal growth and the reciprocal lattice Neutron scattering Incommensurate spin structure and excitations Density functional theory calculations The localized spin model for the incommensurate�phase Roles of the DM interaction and additional anisotropy from�CDW Magnetic intensities of the incommensurate�phase Data availability References Acknowledgements Author contributions Competing interests Additional information