Skip to content

Deploy OAI UE+gNB+Core in K8s #479

New issue
New issue
Closed
#485
Closed
Deploy OAI UE+gNB+Core in K8s#479
#485
Assignees
mbaran0v

Description

@pirog-spb
pirog-spb
opened on Nov 11, 2023

Based on https://gitlab.eurecom.fr/oai/openairinterface5g/-/tree/develop/ci-scripts/yaml_files/5g_l2sim_tdd example

Acceptance criteria:

  • Check config from Deploy eUPF with OAI core #473
  • Update deployment according to it (!)
  • Deploy vanilla OAI in K8s
  • Test 0-scenario
  • Clean up deployment configuration
  • Update deployments description

Activity

  1. pirog-spb
    assigned
    mbaran0v
    on Nov 11, 2023
  2. mbaran0v
    linked a pull request that will close this issuefeat: deployments with OAI #485on Nov 15, 2023

  3. mbaran0v commented on Nov 22, 2023

    @mbaran0v
    mbaran0v
    on Nov 22, 2023
    Contributor

    on our test environment we have 2 pods in ns open5gs:

    • gnb-oai-gnb-0
    • ue-oai-nr-ue-59cf96f9d8-5dx26

    step 1 (pod gnb):

    step 2 (pod ue):

    GNB log:

    [PHY]   tx_reorder_thread started
[NR_MAC]   Frame.Slot 128.0

[NR_MAC]   Frame.Slot 256.0

[NR_MAC]   Frame.Slot 384.0

[HW]   A client connects, sending the current time
[NR_MAC]   Frame.Slot 512.0

[NR_PHY]   [gNB 0][RAPROC] Frame 599, slot 19 Initiating RA procedure with preamble 20, energy 56.4 dB (I0 0, thres 120), delay 0 start symbol 0 freq index 0
[MAC]   UL_info[Frame 599, Slot 19] Calling initiate_ra_proc RACH:SFN/SLOT:599/19
[NR_MAC]   [gNB 0][RAPROC] CC_id 0 Frame 599 Activating Msg2 generation in frame 600, slot 7 using RA rnti 10b SSB, new rnti dca9 index 0 RA index 0
[NR_MAC]   [gNB 0][RAPROC] CC_id 0 Frame 600, slotP 7: Generating RA-Msg2 DCI, rnti 0x10b, state 1, CoreSetType 2
[NR_MAC]   [RAPROC] Msg3 slot 17: current slot 7 Msg3 frame 600 k2 7 Msg3_tda_id 3
[NR_MAC]   [gNB 0][RAPROC] Frame 600, Subframe 7: rnti dca9 RA state 2
[NR_MAC]   Adding UE with rnti 0xdca9
[NR_MAC]   [gNB 0][RAPROC] PUSCH with TC_RNTI 0xdca9 received correctly, adding UE MAC Context RNTI 0xdca9
[NR_MAC]   [RAPROC] RA-Msg3 received (sdu_lenP 7)
[MAC]   [RAPROC] Received SDU for CCCH length 6 for UE dca9
[RLC]   activated srb0 for UE with RNTI 0xdca9
[RLC]   Added srb 1 to UE with RNTI 0xdca9
[NR_MAC]   Activating scheduling RA-Msg4 for TC_RNTI 0xdca9 (state 2)
[NR_MAC]   Unexpected ULSCH HARQ PID 0 (have -1) for RNTI 0xdca9 (ignore this warning for RA)
[NR_RRC]   Decoding CCCH: RNTI dca9, payload_size 6
[NR_RRC]   Returning new RRC UE context RRC ue id: 1
[NR_RRC]   Created new UE context: CU UE ID 1 DU UE ID 56489 (rnti: dca9, random ue id 5ebc35a93c000000)
[NR_RRC]   rrc_gNB_generate_RRCSetup for RNTI dca9
[NR_MAC]   No CU UE ID stored for UE RNTI dca9, adding CU UE ID 1
[NR_MAC]   ( 601. 5) SRB0 has 137 bytes
[NR_MAC]   UE dca9 Generate msg4: feedback at  601. 7, payload 149 bytes, next state WAIT_Msg4_ACK
[HW]   Lost socket
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  601.17, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  602. 7, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  602.17, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]    603. 3 UE dca9: RA Procedure failed at Msg4!
[NR_MAC]   Frame.Slot 640.0
UE RNTI dca9 (1) PH 0 dB PCMAX 0 dBm, average RSRP 0 (0 meas)
UE dca9: dlsch_rounds 1/1/1/1, dlsch_errors 1, pucch0_DTX 4, BLER 0.00000 MCS 0
UE dca9: dlsch_total_bytes 0
UE dca9: ulsch_rounds 0/0/0/0, ulsch_DTX 0, ulsch_errors 0, BLER 0.00000 MCS 0
UE dca9: ulsch_total_bytes_scheduled 0, ulsch_total_bytes_received 0
UE dca9: LCID 1: TX              0 RX              0 bytes

[NR_MAC]   Frame.Slot 768.0
UE RNTI dca9 (1) PH 0 dB PCMAX 0 dBm, average RSRP 0 (0 meas)
UE dca9: dlsch_rounds 1/1/1/1, dlsch_errors 1, pucch0_DTX 4, BLER 0.00000 MCS 0
UE dca9: dlsch_total_bytes 0
UE dca9: ulsch_rounds 0/0/0/0, ulsch_DTX 0, ulsch_errors 0, BLER 0.00000 MCS 0
UE dca9: ulsch_total_bytes_scheduled 0, ulsch_total_bytes_received 0
UE dca9: LCID 1: TX              0 RX              0 bytes

    ue log

    [SIM]   UICC simulation: IMSI=999700000000001, IMEISV=6754567890123413, Ki=465B5CE8B199B49FAA5F0A2EE238A6BC, OPc=E8ED289DEBA952E4283B54E88E6183CA, DNN=internet, SST=0x01, SD=0x111111
[HW]   Trying to connect to 10.233.50.146:4043
[HW]   Connection to 10.233.50.146:4043 established
[HW]   connect() to 10.233.50.146:4043 failed, errno(0)
[PHY]   [SCHED][UE] Check absolute frequency DL 3319680000.000000, UL 3319680000.000000 (RF card 0, oai_exit 0, channel 0, rx_num_channels 1)
[NR_PHY]   Starting sync detection
[PHY]   [UE thread Synch] Running Initial Synch
[PHY]   [UE] nr_synchro_time: Sync source = 0, Peak found at pos 0, val = 0 (0 dB) avg 0 dB, ffo 0.000000
[PHY]   PSS execution duration 66985 microseconds
[PHY]   [UE] nr_synchro_time: Sync source = 0, Peak found at pos 85696, val = 1818396808 (90 dB) avg 51 dB, ffo 0.000000
[PHY]   PSS execution duration 66098 microseconds
[PHY]   [UE0] Initial sync : Estimated PSS position 85696, Nid2 0
[PHY]   sync_pos 85696 ssb_offset 85588
[PHY]   Calling sss detection (normal CP)
[NR_PHY]   ffo_pss 0.000000 (0 Hz), ffo_sss 0.000663 (19 Hz),  ffo_pss+ffo_sss 0.000663 (19 Hz), nid1: 0, nid2: 0
[PHY]   [UE0] Initial sync: starting PBCH detection (rx_offset 0)
[PHY]   [UE0] Initial sync: pbch decoded sucessfully, ssb index 0
[NR_RRC]   Configuring MAC for first MIB reception
[PHY]   TDD Normal prefix: CellId 0 metric 45105, phase 7, pbch 0
[PHY]   [UE0] In synch, rx_offset 82276 samples
[PHY]   [UE 0] Measured Carrier Frequency 3319680000 Hz (offset 0 Hz)
[PHY]   HW: Configuring channel 0 (rf_chain 0): setting tx_freq 3319680000 Hz, rx_freq 3319680000 Hz, tune_offset 0
[PHY]   Got synch: hw_slot_offset 7, carrier off 0 Hz, rxgain 0.000000 (DL 3319680000.000000 Hz, UL 3319680000.000000 Hz)
[PHY]   UE synchronized decoded_frame_rx=462 UE->init_sync_frame=0 trashed_frames=30
[PHY]   Resynchronizing RX by 82276 samples
[NR_RRC]   SIB1 decoded
[NR_MAC]   NR band duplex spacing is 0 KHz (nr_bandtable[37].band = 78)
[NR_MAC]   NR band 78, duplex mode TDD, duplex spacing = 0 KHz
[NR_PHY]   ============================================
[NR_PHY]   Harq round stats for Downlink: 1/0/0
[NR_PHY]   ============================================
[NR_PHY]   ============================================
[NR_PHY]   Harq round stats for Downlink: 1/0/0
[NR_PHY]   ============================================
Entering ITTI signals handler
TYPE <CTRL-C> TO TERMINATE
[NR_MAC]   NR band duplex spacing is 0 KHz (nr_bandtable[37].band = 78)
[NR_MAC]   NR band 78, duplex mode TDD, duplex spacing = 0 KHz
[MAC]   Initialization of 4-step contention-based random access procedure
[NR_MAC]   PRACH scheduler: Selected RO Frame 599, Slot 19, Symbol 0, Fdm 0
[PHY]   PRACH [UE 0] in frame.slot 599.19, placing PRACH in position 2452, msg1 frequency start 27 (k1 27), preamble_offset 5, first_nonzero_root_idx 0
[NR_MAC]   [UE 0][RAPROC] Got BI RAR subPDU 5 ms
[NR_MAC]   [UE 0][RAPROC] Got RAPID RAR subPDU
[NR_MAC]   [UE 0][RAPROC][600.7] Found RAR with the intended RAPID 20
[MAC]   received TA command 31
[RLC]   activated srb0 for UE with RNTI 0xdca9
[PHY]   RAR-Msg2 decoded
[NR_MAC]   [RAPROC][600.17] RA-Msg3 transmitted

Assertion (1 + dci->pdsch_to_harq_feedback_timing_indicator.val > ((3))) failed!
In nr_ue_process_dci_dl_10() ../../../openair2/LAYER2/NR_MAC_UE/nr_ue_procedures.c:783
PDSCH to HARQ feedback time (2) needs to be higher than DURATION_RX_TO_TX (3).

Exiting execution
../../../openair2/LAYER2/NR_MAC_UE/nr_ue_procedures.c:783 nr_ue_process_dci_dl_10() Exiting OAI softmodem: _Assert_Exit_
Aborted (core dumped)
  4. pirog-spb
    changed the title [-]Deploy OAI gNB and UE with open5gs in K8s[/-] [+]Deploy OAI UE+gNB+Core in K8s[/+] on Nov 23, 2023

  5. mbaran0v commented on Nov 26, 2023

    @mbaran0v
    mbaran0v
    on Nov 26, 2023
    Contributor

    OAI core + RAN works normally
    deployed by this documentation https://gitlab.eurecom.fr/oai/cn5g/oai-cn5g-fed/-/blob/master/docs/DEPLOY_SA5G_HC.md
    used scenario oai-5g-basic

  6. mbaran0v commented on Nov 29, 2023

    @mbaran0v
    mbaran0v
    on Nov 29, 2023
    Contributor

    last messages from UE

    [NR_MAC]   [UE 0][RAPROC] Got BI RAR subPDU 5 ms
[NR_MAC]   [UE 0][RAPROC] Got RAPID RAR subPDU
[NR_MAC]   [UE 0][RAPROC][492.7] Found RAR with the intended RAPID 13
[MAC]   received TA command 31
[NR_MAC]   [RAPROC][492.17] RA-Msg3 transmitted
[MAC]   [UE 0][RAPROC] Frame 493 : received contention resolution identity: 0x1b318aa13806 Terminating RA procedure
[MAC]   [UE 0][493.10][RAPROC] RA procedure succeeded. CB-RA: Contention Resolution is successful.
CMDLINE: "/opt/oai-nr-ue/bin/nr-uesoftmodem" "-O" "/opt/oai-nr-ue/etc/nr-ue.conf" "--sa" "-E" "--rfsim" "-r" "106" "--numerology" "1" "-C" "3619200000" "--nokrnmod" 
[CONFIG] get parameters from libconfig /opt/oai-nr-ue/etc/nr-ue.conf [LIBCONFIG] Path for include directive set to: /opt/oai-nr-ue/etc
[CONFIG] function config_libconfig_init returned 0
[CONFIG] config module libconfig loaded
[LIBCONFIG] config: 2/2 parameters successfully set, (2 to default value)
[CONFIG] debug flags: 0x00000000
[LIBCONFIG] log_config: 3/3 parameters successfully set, (2 to default value)
[LIBCONFIG] log_config: 53/53 parameters successfully set, (53 to default value)
[LIBCONFIG] log_config: 53/53 parameters successfully set, (53 to default value)
[LIBCONFIG] log_config: 16/16 parameters successfully set, (16 to default value)
[LIBCONFIG] log_config: 16/16 parameters successfully set, (16 to default value)
log init done
[LIBCONFIG] (root): 30/30 parameters successfully set, (28 to default value)
[LIBCONFIG] (root): 37/37 parameters successfully set, (34 to default value)
[LIBCONFIG] (root): 6/6 parameters successfully set, (5 to default value)
[LIBCONFIG] TTracer: 3/3 parameters successfully set, (3 to default value)
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
CPU Freq is 2.294547 
[LIBCONFIG] opt: 3/3 parameters successfully set, (3 to default value)
[LIBCONFIG] loader: 2/2 parameters successfully set, (2 to default value)
[LIBCONFIG] loader.ldpc: 2/2 parameters successfully set, (1 to default value)
shlib_path libldpc.so
[LOADER] library libldpc.so successfully loaded
[LIBCONFIG] nas.noS1: 3/3 parameters successfully set, (3 to default value)
DL frequency 3619200000: band 48, UL frequency 3619200000
[LIBCONFIG] loader.dfts: 2/2 parameters successfully set, (1 to default value)
shlib_path libdfts.so
[LOADER] library libdfts.so successfully loaded
[LIBCONFIG] list PRSs not found in config file /opt/oai-nr-ue/etc/nr-ue.conf 
[LIBCONFIG] device.recplay: 8/8 parameters successfully set, (8 to default value)
[LIBCONFIG] device: 1/1 parameters successfully set, (1 to default value)
[LIBCONFIG] loader.rfsimulator: 2/2 parameters successfully set, (1 to default value)
shlib_path librfsimulator.so
[LOADER] library librfsimulator.so successfully loaded
[LIBCONFIG] rfsimulator: 9/9 parameters successfully set, (8 to default value)
Initializing random number generator, seed 1346137380399827779
UE threads created by 1
TYPE <CTRL-C> TO TERMINATE
[LIBCONFIG] uicc0: 10/10 parameters successfully set, (5 to default value)
Entering ITTI signals handler
TYPE <CTRL-C> TO TERMINATE
<DL-CCCH-Message>
    <message>
        <c1>
            <rrcSetup>
                <rrc-TransactionIdentifier>2</rrc-TransactionIdentifier>
                <criticalExtensions>
                    <rrcSetup>
                        <radioBearerConfig>
                            <srb-ToAddModList>
                                <SRB-ToAddMod>
                                    <srb-Identity>1</srb-Identity>
                                </SRB-ToAddMod>
                            </srb-ToAddModList>
                        </radioBearerConfig>
                        <masterCellGroup>
                            5C 00 B0 01 11 7A EC 70 10 61 F0 00 7C 02 04 68 
                            3C 08 00 04 12 09 81 95 00 81 FF FF 00 00 00 01 
                            00 00 37 14 42 00 00 80 16 50 00 04 82 00 00 44 
                            09 34 0D 54 93 50 00 04 00 80 80 01 00 1A 02 00 
                            27 6C 96 30 1D C0 76 78 9A BC D0 00 00 29 A1 00 
                            20 00 25 80 C2 0C 02 C9 C1 82 1C 00 31 28 1C 00 
                            00 20 5E F4 01 00 01 00 00 06 40 01 40 03 2A 0A 
                            00 C4 40 15 00 00 00 00 01 42 00 80 00 14 50 80 
                            80 02 C6 00
                        </masterCellGroup>
                    </rrcSetup>
                </criticalExtensions>
            </rrcSetup>
        </c1>
    </message>
</DL-CCCH-Message>
[NR_RRC]   [UE0][RAPROC] Frame 493 : Logical Channel DL-CCCH (SRB0), Received NR_RRCSetup RNTI 5db3
[RRC]   Received mac_CellGroupConfig from gNB
[MAC]   Applying CellGroupConfig from gNodeB
[RLC]   ../../../openair2/LAYER2/nr_rlc/nr_rlc_oai_api.c:693:nr_rlc_add_srb: added srb 1 to UE with RNTI 0x5db3
[NR_RRC]   [UE 0], CONFIG_SRB1 1 corresponding to gNB_index 0
[NR_RRC]   [FRAME 00493][RRC_UE][MOD 00][][--- MAC_CONFIG_REQ  (SRB1 gNB 0) --->][MAC_UE][MOD 00][]
[NR_RRC]   [UE 0] State = NR_RRC_CONNECTED (gNB 0)
[NR_RRC]   [UE 0][RAPROC] Frame 493 : Logical Channel UL-DCCH (SRB1), Generating RRCSetupComplete (bytes42, gNB 0)
[NR_RRC]   [UE 0] Received RRC Release (gNB 0)
[NAS]   [UE 0] Received NAS_DOWNLINK_DATA_IND: length 4 , buffer 0x7fd9f8002fc0
[NR_RRC]   unknown message type 68
[NAS]   [UE 0] Received NAS_CONN_RELEASE_IND: cause 0
Returned from ITTI signal handler
oai_exit=1
Stream closed EOF for open5gs/oai-nr-ue-5cc6b949f8-ctk8g (nr-ue)

  7. mbaran0v commented on Nov 29, 2023

    @mbaran0v
    mbaran0v
    on Nov 29, 2023
    Contributor

    amf log:

    11/29 14:36:14.644: [amf] INFO: InitialUEMessage (../src/amf/ngap-handler.c:372)
11/29 14:36:14.644: [amf] INFO: [Added] Number of gNB-UEs is now 1 (../src/amf/context.c:2481)
11/29 14:36:14.644: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[8] TAC[1] CellID[0xe0000] (../src/amf/ngap-handler.c:533)
11/29 14:36:14.645: [amf] INFO: [suci-0-999-70-0000-0-0-0000000001] Unknown UE by SUCI (../src/amf/context.c:1778)
11/29 14:36:14.645: [amf] INFO: [Added] Number of AMF-UEs is now 1 (../src/amf/context.c:1560)
11/29 14:36:14.645: [gmm] INFO: Registration request (../src/amf/gmm-sm.c:985)
11/29 14:36:14.645: [gmm] ERROR: Non cleartext IEs is included [0x6] (../src/amf/gmm-handler.c:116)
11/29 14:36:14.645: [gmm] ERROR: Unknown reg_type[0] (../src/amf/gmm-sm.c:1004)
11/29 14:36:14.645: [gmm] ERROR: gmm_handle_registration_request() failed [95] (../src/amf/gmm-sm.c:1008)
11/29 14:36:14.645: [amf] ERROR: Unknown reg_type[0] (../src/amf/nas-path.c:215)
11/29 14:36:14.645: [amf] WARNING: [(null)] Registration reject [95] (../src/amf/nas-path.c:219)
11/29 14:36:14.648: [amf] INFO: UE Context Release [Action:3] (../src/amf/ngap-handler.c:1632)
11/29 14:36:14.648: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[8] (../src/amf/ngap-handler.c:1633)
11/29 14:36:14.649: [amf] INFO:     SUCI[Unknown] (../src/amf/ngap-handler.c:1636)
11/29 14:36:14.649: [amf] INFO: [Removed] Number of gNB-UEs is now 0 (../src/amf/context.c:2488)
11/29 14:36:14.649: [amf] INFO: [Removed] Number of AMF-UEs is now 0 (../src/amf/context.c:1653)
11/29 14:36:45.365: [amf] INFO: InitialUEMessage (../src/amf/ngap-handler.c:372)
11/29 14:36:45.366: [amf] INFO: [Added] Number of gNB-UEs is now 1 (../src/amf/context.c:2481)
11/29 14:36:45.366: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[9] TAC[1] CellID[0xe0000] (../src/amf/ngap-handler.c:533)
11/29 14:36:45.367: [amf] INFO: [suci-0-999-70-0000-0-0-0000000001] Unknown UE by SUCI (../src/amf/context.c:1778)
11/29 14:36:45.367: [amf] INFO: [Added] Number of AMF-UEs is now 1 (../src/amf/context.c:1560)
11/29 14:36:45.367: [gmm] INFO: Registration request (../src/amf/gmm-sm.c:985)
11/29 14:36:45.367: [gmm] ERROR: Non cleartext IEs is included [0x6] (../src/amf/gmm-handler.c:116)
11/29 14:36:45.367: [gmm] ERROR: Unknown reg_type[0] (../src/amf/gmm-sm.c:1004)
11/29 14:36:45.367: [gmm] ERROR: gmm_handle_registration_request() failed [95] (../src/amf/gmm-sm.c:1008)
11/29 14:36:45.367: [amf] ERROR: Unknown reg_type[0] (../src/amf/nas-path.c:215)
11/29 14:36:45.367: [amf] WARNING: [(null)] Registration reject [95] (../src/amf/nas-path.c:219)
11/29 14:36:45.368: [amf] INFO: UE Context Release [Action:3] (../src/amf/ngap-handler.c:1632)
11/29 14:36:45.368: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[9] (../src/amf/ngap-handler.c:1633)
11/29 14:36:45.368: [amf] INFO:     SUCI[Unknown] (../src/amf/ngap-handler.c:1636)
11/29 14:36:45.368: [amf] INFO: [Removed] Number of gNB-UEs is now 0 (../src/amf/context.c:2488)
11/29 14:36:45.368: [amf] INFO: [Removed] Number of AMF-UEs is now 0 (../src/amf/context.c:1653)
  8. mbaran0v
    closed this as completedin #485on Dec 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions