bpf: Enable task local storage for tracing programs
To access per-task data, BPF programs usually creates a hash table with pid as the key. This is not ideal because: 1. The user need to estimate the proper size of the hash table, which may be inaccurate; 2. Big hash tables are slow; 3. To clean up the data properly during task terminations, the user need to write extra logic. Task local storage overcomes these issues and offers a better option for these per-task data. Task local storage is only available to BPF_LSM. Now enable it for tracing programs. Unlike LSM programs, tracing programs can be called in IRQ contexts. Helpers that access task local storage are updated to use raw_spin_lock_irqsave() instead of raw_spin_lock_bh(). Tracing programs can attach to functions on the task free path, e.g. exit_creds(). To avoid allocating task local storage after bpf_task_storage_free(). bpf_task_storage_get() is updated to not allocate new storage when the task is not refcounted (task->usage == 0). Signed-off-by:Song Liu <songliubraving@fb.com> Signed-off-by:
Alexei Starovoitov <ast@kernel.org> Acked-by:
KP Singh <kpsingh@kernel.org> Acked-by:
Martin KaFai Lau <kafai@fb.com> Link: https://lore.kernel.org/bpf/20210225234319.336131-2-songliubraving@fb.com
Showing
- include/linux/bpf.h 7 additions, 0 deletionsinclude/linux/bpf.h
- include/linux/bpf_lsm.h 0 additions, 22 deletionsinclude/linux/bpf_lsm.h
- include/linux/bpf_types.h 1 addition, 1 deletioninclude/linux/bpf_types.h
- include/linux/sched.h 5 additions, 0 deletionsinclude/linux/sched.h
- kernel/bpf/Makefile 1 addition, 2 deletionskernel/bpf/Makefile
- kernel/bpf/bpf_local_storage.c 17 additions, 11 deletionskernel/bpf/bpf_local_storage.c
- kernel/bpf/bpf_lsm.c 0 additions, 4 deletionskernel/bpf/bpf_lsm.c
- kernel/bpf/bpf_task_storage.c 11 additions, 32 deletionskernel/bpf/bpf_task_storage.c
- kernel/fork.c 5 additions, 0 deletionskernel/fork.c
- kernel/trace/bpf_trace.c 4 additions, 0 deletionskernel/trace/bpf_trace.c
Loading
Please register or sign in to comment