Data Labeling Analyst IV

Premium Subscriptions SME

Blurb
We're hiring experienced social media marketing practitioners to serve as domain experts evaluating AI-powered business tools covering performance analytics, brand listening, and creator partnerships on Facebook and Instagram.

You'll judge whether AI outputs are accurate, insightful, and genuinely useful to a business a cross performance diagnostics, brand sentiment monitoring and creator partnership recommendations. This is a systematic evaluation role . You'll apply structured QA methodologies to assess AI quality at scale, not just offer subjective opinions.
Ideal Background
3+ years in social media marketing, digital marketing, or performance marketing (agency, in-house, or freelance) where you've personally handled multiple of the following:
Performance analytics & diagnostics: Interpreted content metrics (reach, engagement rate, completion rate, saves, shares, follower growth), diagnosed why content performed well or poorly, identified patterns across formats/timing/topics, made data-informed strategy recommendations
Brand monitoring / social listening: Tracked brand mentions, classified sentiment (positive/negative/neutral including sarcasm and ambiguity), managed reputation spikes, identified themes driving conversation, recommended response strategies. Experience with tools like Brandwatch, Sprout Social, Meltwater, or native platform analytics
Influencer/creator marketing: Sourced and vetted creators, evaluated audience demographics (age/gender/location breakdowns), assessed brand-creator fit, identified red flags (fake engagement, competitive conflicts, brand safety), written or reviewed brand-to-creator outreach
Deep familiarity with Facebook and Instagram business ecosystems. You understand algorithmic distribution, engagement dynamics, content formats, and audience behaviour differences across platforms
Ability to distinguish genuinely insightful analysis from surface-level number recitation. You know what a good strategist would say vs. what a dashboard already shows
Understanding of creator tier dynamics (nano through macro) and how partnership evaluation differs by scale
AI/LLM familiarity: Comfort working with AI-generated outputs and understanding where large language models commonly fail (hallucination, confident incorrectness, generic responses, data fabrication)
Experience across multiple verticals or business types preferred

Nice to Have
Quality assurance / systematic evaluation experience: Prior work in QA, content quality assurance, annotation/labeling, or AI output evaluation is helpful. We’d love if you've designed rubrics, executed test cases against edge cases, maintained inter-rater reliability, or worked in a structured evaluation pipeline (RLHF, red-teaming, data labeling, or similar)
Experience in content moderation, trust & safety, or policy enforcement at scale
Background in data annotation, labeling pipelines, or RLHF workflows
Familiarity with evaluation frameworks (precision/recall thinking, confusion matrices, gold-standard labeling)
Multilingual capabilities for evaluating non-English AI outputs

What You'll Evaluate
Are cited metrics, percentages, trends, and audience breakdowns factually accurate?
Is sentiment classification correct, including edge cases (sarcasm, mixed, non-English)?
Are performance diagnoses genuinely non-obvious (root causes, correlations) or just restating numbers?
Are strategic recommendations specific, proportionate, and evidence-backed, not generic advice?
Are creator recommendations genuinely good fits (vertical, audience, content style, brand safety)?
Are competitive conflicts, authenticity red flags, or brand safety issues correctly identified?
Are outreach messages personalized to specific creators, or templated?

Collaboration
You'll work closely with Program managers, data analysts and data labellers to surface quality patterns, inform model improvements, and establish quality benchmarks. Expect to participate in calibration sessions and contribute to evaluation methodology design.

Role B: Content Specialist
Headcount: 1
Work Format: Contract / Vendor (Remote)
Blurb
We're hiring an experienced content creator and creative strategist to serve as the domain expert evaluating AI-powered content creation tools. You'll judge whether AI-generated creative output (copy, visuals, content plans, and messaging) is high-quality, on-brand, platform-appropriate, and genuinely publish-ready.

Your core judgment: could a business look at this output and use it with minimal edits, or does it feel generic, off-tone, visually subpar, or strategically hollow?

This is a systematic evaluation role . You'll apply structured QA methodologies to assess AI-generated creative quality at scale, identifying patterns of failure and maintaining consistent quality standards.
Ideal Background
3+ years in social media content creation, brand copywriting, content strategy, or creative direction (agency, in-house, or as a professional creator)
Proven ability to assess brand voice consistency. You can tell when copy sounds authentically like a specific business vs. generically AI-generated, and articulate precisely why
Strong understanding of platform-native content formats and conventions: Instagram Reels (hooks, pacing, aspect ratios), Stories (sticker strategy, flow), carousels (narrative structure, slide hierarchy), feed posts, Facebook Reels and posts. You know what "good" looks like on each surface
Visual creative judgment. You can assess whether AI-generated images/graphics are publish-ready (composition, quality, brand consistency, correct dimensions/safe zones) or need rework
Experience writing social captions, hooks, CTAs, and hashtag strategies across different brand tones (playful, professional, luxury, edgy, informational)
Understanding of content calendars and editorial planning. You know how format mix, timing, and topic selection should be informed by performance data and audience signals
Experience across different verticals (beauty, food, fitness, tech, fashion, B2B, local businesses). You understand "good content" looks very different for a bakery vs. a SaaS company
Familiarity with how content creation connects to performance. You've seen how hooks, caption length, visual style, and format choices drive engagement
AI/LLM familiarity: Comfort working with AI-generated content (text and image) and understanding common failure patterns: generic outputs, hallucinated data, brand voice drift, visual artifacts, policy-violating suggestions
Experience with creative tools and platforms: Canva, CapCut, Later, Figma, Adobe Creative Suite, or similar. You understand the production pipeline from concept to publish

Nice to Have
Quality assurance / systematic evaluation experience: Prior work in QA, content quality assurance, annotation/labeling, or AI output evaluation. You've designed or applied rubrics, evaluated creative assets against defined standards, maintained consistency across high-volume review, or worked in a structured evaluation pipeline
Experience in content moderation or creative QA at scale (ad review, UGC moderation, editorial QA)
Background in annotation, labeling, or RLHF workflows for generative AI
Familiarity with AI image generation tools (Midjourney, DALL-E, Meta's Imagine) and their common artifacts
Multilingual content evaluation capabilities
Experience defining style guides or brand voice documentation

What You'll Evaluate
Does generated copy match the specific business's brand voice (tone, vocabulary, emoji usage, length), or could it belong to any brand?
Are visuals publish-ready (quality, aspect ratio, styling, platform conventions)?
Are content calendars grounded in the user's actual performance patterns, or generic best-practice filler?
Are creative suggestions culturally appropriate, policy-compliant, and original (not plagiarised)?
Is the output complete and immediately usable, or does it feel like a rough draft needing significant rework?
Are data-backed justifications for creative choices accurate, or is hallucinated performance data being used to sell generic ideas?

Collaboration
You'll work closely with Program managers, data analysts and data labellers to surface creative quality patterns, inform model improvements, and establish quality benchmarks for generative content. Expect to participate in calibration sessions and contribute to evaluation methodology design.

This posting is for a contract assignment with Tundra Technical Solutions to provide services to Meta.

The pay range that Tundra in good faith reasonably expects to pay for this position is $18.00/hour - $29.00/hour.

Tundra’s benefits offering includes optional medical, dental, vision, retirement benefits, up to 15 Days PTO per annum and a New Child Benefit.

Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.

Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.

The Meta CWX Program is enabled by a cutting-edge software platform called TalentNet that leads the contingent labor world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.

At Meta, we are constantly iterating, solving problems, and working together to connect people all over the world. That’s why it’s important that our workforce reflects the diversity of the people we serve. Hiring people with different backgrounds and points of view helps us make better decisions, build better products, and create better experiences for everyone.

We give people the power to build community and bring the world closer together. Our products empower more than 3 billion people around the world to share ideas, offer support, and make a difference.

This posting is for a contract assignment with Tundra Technical Solutions to provide services to Meta. Please note that this is not a full-time employment opportunity. Candidates selected for this role will be engaged as contractors for the specified duration of the project. For any inquiries regarding the terms of the contract or engagement, please contact Tundra Technical Solutions directly.