When Career Data Runs Out: Structured Feature Engineering and Signal Limits for Founder Success Prediction
- URL: http://arxiv.org/abs/2604.00339v1
- Date: Wed, 01 Apr 2026 00:28:53 GMT
- Title: When Career Data Runs Out: Structured Feature Engineering and Signal Limits for Founder Success Prediction
- Abstract summary: Predicting startup success from founder career data is hard.<n>We engineer 28 structured features directly from raw fields -- jobs, education, exits -- and combine them with a deterministic rule layer and XG boosted stumps.<n>Our model achieves Val F0.5 = 0.3030, Precision = 0.3333, Recall = 0.2222 -- +17.7pp improvement over the zero-shot LLM baseline.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Predicting startup success from founder career data is hard. The signal is weak, the labels are rare (9%), and most founders who succeed look almost identical to those who fail. We engineer 28 structured features directly from raw JSON fields -- jobs, education, exits -- and combine them with a deterministic rule layer and XGBoost boosted stumps. Our model achieves Val F0.5 = 0.3030, Precision = 0.3333, Recall = 0.2222 -- a +17.7pp improvement over the zero-shot LLM baseline. We then run a controlled experiment: extract 9 features from the prose field using Claude Haiku, at 67% and 100% dataset coverage. LLM features capture 26.4% of model importance but add zero CV signal (delta = -0.05pp). The reason is structural: anonymised_prose is generated from the same JSON fields we parse directly -- it is a lossy re-encoding, not a richer source. The ceiling (CV ~= 0.25, Val ~= 0.30) reflects the information content of this dataset, not a modeling limitation. In characterizing where the signal runs out and why, this work functions as a benchmark diagnostic -- one that points directly to what a richer dataset would need to include.
Related papers
- Output Format x Model Identity: Interaction Effects in Single-Round Coding Agent Performance [4.342406076796542]
We conduct a controlled experiment with 3 models (DeepSeek V4, Doubao 2.0, Qwen 3.7 Max)<n>We identify a distinct failure mechanism -- format misuse where agents execute it with excessive scope.<n>We propose a model-specific strategy, a tooldesign principle that constrains format semantics to the agent's own step.
arXiv Detail & Related papers (2026-07-23T10:18:42Z) - Knowledge Graphs as the Missing Data Layer for LLM-Based Industrial Asset Operations [0.0]
LLM-based agents for industrial asset operations show limited accuracy when reasoning over flat document stores.<n> AssetOpsBench establishes that GPT-4 agents achieve 65% on 139 industrial maintenance scenarios.<n>We treat a typed knowledge graph as a grounding substrate and route each question by how it is best answered.
arXiv Detail & Related papers (2026-05-26T11:31:46Z) - Correct Code, Vulnerable Dependencies: A Large Scale Measurement Study of LLM-Specified Library Versions [52.50730821321986]
We present the first large-scale measurement study of version-level risk in large language models (LLMs)<n>We evaluate 10 LLMs on PinTrace, a curated benchmark of 1,000 Stack Overflow programming tasks.<n>Our findings reveal LLM version selection as a first-class, previously overlooked risk surface in LLM-based development.
arXiv Detail & Related papers (2026-05-07T13:52:59Z) - From Code to Prediction: Fine-Tuning LLMs for Neural Network Performance Classification in NNGPT [48.83701310501069]
We present a classification task integrated into the NNGPT framework.<n>A fine-tuned LLM predicts which of two image classification datasets a given neural network architecture achieves higher accuracy on.<n>The results establish that LLMs can be fine-tuned to predict cross-dataset suitability from neural network code.
arXiv Detail & Related papers (2026-05-05T12:30:19Z) - APEX-EM: Non-Parametric Online Learning for Autonomous Agents via Structured Procedural-Episodic Experience Replay [7.370176470430802]
We present textbfAPEX-EM, a non-parametric online learning framework that accumulates, retrieves, and reuses structured procedural plans.<n>APEX-EM achieves 89.6% accuracy versus 41.3% without memory (+48.3pp), surpassing the oracle-retrieval upper bound.<n>On BigCodeBench, it reaches 83.3% SR from a 53.9% baseline (+29.4pp), exceeding MemRL'scitememrl2025 +11.0pp gain under comparable frozen-backbone conditions.
arXiv Detail & Related papers (2026-03-31T00:24:56Z) - Towards Improved Sentence Representations using Token Graphs [41.412173502714225]
We introduce GLOT, a structure-aware pooling module that reframes pooling as relational learning followed by aggregation.<n>On a diagnostic stress test where 90% of tokens are random distractors, GLOT maintains over 97% accuracy while baseline methods collapse.<n>It is competitive with state-of-the-art techniques on benchmarks like GLUE and MTEB with 20x fewer trainable parameters and speeds up the training time by over 100x compared with parameter-efficient fine-tuning methods.
arXiv Detail & Related papers (2026-03-03T09:00:01Z) - CauScientist: Teaching LLMs to Respect Data for Causal Discovery [25.77810792733626]
CauScientist is a framework that synergizes "data scientists" with probabilistic statistics as rigorous "verifiers"<n>Experiments demonstrate that CauScientist substantially outperforms purely data-driven baselines.<n>CauScientist reduces structural hamming distance (SHD) by 44.0% compared to Qwen3-32B on 37-node graphs.
arXiv Detail & Related papers (2026-01-20T05:32:22Z) - Semantic Soft Bootstrapping: Long Context Reasoning in LLMs without Reinforcement Learning [46.765013720309064]
Long context reasoning in large language models (LLMs) has demonstrated enhancement of their cognitive capabilities via chain-of-thought (CoT) inference.<n>Training such models is usually done via reinforcement learning with verifiable rewards (RLVR) in reasoning based problems, like math and programming.<n>We propose textbfSemantic Soft Bootstrapping ( SSB), a self-distillation technique, in which the same base language model plays the role of both teacher and student, but receives different semantic contexts about the correctness of its outcome at training time.
arXiv Detail & Related papers (2025-12-04T18:59:18Z) - Input-Time Scaling [2.2917707112773598]
Current Large Language Models (LLMs) are usually post-trained on large-scale carefully curated datasets.<n>We present a new scaling paradigm, Input-Time Scaling, to complement previous scaling methods by putting resources on queries.<n>We are also surprised to find that seemingly low data quality datasets can perform better.
arXiv Detail & Related papers (2025-08-19T09:04:13Z) - Hey, That's My Data! Label-Only Dataset Inference in Large Language Models [63.35066172530291]
CatShift is a label-only dataset-inference framework.<n>It capitalizes on catastrophic forgetting: the tendency of an LLM to overwrite previously learned knowledge when exposed to new data.
arXiv Detail & Related papers (2025-06-06T13:02:59Z) - Be Careful When Fine-tuning On Open-Source LLMs: Your Fine-tuning Data Could Be Secretly Stolen! [77.5835471257498]
Fine-tuning on open-source Large Language Models (LLMs) with proprietary data is now a standard practice for downstream developers.<n>We reveal a new and concerning risk along with the practice: the creator of the open-source LLMs can later extract the private downstream fine-tuning data.
arXiv Detail & Related papers (2025-05-21T15:32:14Z) - Can Large Language Models Analyze Graphs like Professionals? A Benchmark, Datasets and Models [70.03602551880526]
We introduce ProGraph, a benchmark for large language models (LLMs) to process graphs.<n>Our findings reveal that the performance of current LLMs is unsatisfactory, with the best model achieving only 36% accuracy.<n>We propose LLM4Graph datasets, which include crawled documents and auto-generated codes based on 6 widely used graph libraries.
arXiv Detail & Related papers (2024-09-29T11:38:45Z) - RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large
Language Models [56.51705482912727]
We present RankVicuna, the first fully open-source LLM capable of performing high-quality listwise reranking in a zero-shot setting.
Experimental results on the TREC 2019 and 2020 Deep Learning Tracks show that we can achieve effectiveness comparable to zero-shot reranking with GPT-3.5 with a much smaller 7B parameter model, although our effectiveness remains slightly behind reranking with GPT-4.
arXiv Detail & Related papers (2023-09-26T17:31:57Z) - Self-Supervised Pre-Training for Transformer-Based Person
Re-Identification [54.55281692768765]
Transformer-based supervised pre-training achieves great performance in person re-identification (ReID)
Due to the domain gap between ImageNet and ReID datasets, it usually needs a larger pre-training dataset to boost the performance.
This work aims to mitigate the gap between the pre-training and ReID datasets from the perspective of data and model structure.
arXiv Detail & Related papers (2021-11-23T18:59:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.