Teburin Abubuwan Ciki
17 Manufofin Ci Gaba Mai Dorewa Da Aka Magance
Manufofin Ci Gaba Mai Dorewa da ake niyya da shirye-shiryen AI
3 Tsarin Zuri'a
An gano tsarin matsaloli da mafita na gama gari
7 Tsarin Haɗin Kai
An rubuta hanyoyin haɗin gwiwa daban-daban
1. Gabatarwa
Ƙungiyar AI don kyautatawa ta kai wani muhimmin lokaci inda ɗimbin nunin ya nuna yuwuwar haɗin gwiwa tsakanin masu aiwatar da AI da ƙungiyoyin sauyi na zamantakewa. Duk da haka, canzawa daga nunin sau ɗaya zuwa tasiri mai aunawa, mai dorewa yana buƙatar canji na asali a cikin tsarin. Wannan takarda tana ba da shawarar buɗaɗɗen dandamali waɗanda ke ɗauke da ƙwararrun iyawar AI don tallafawa buƙatun gama gari a cikin ƙungiyoyi da yawa waɗanda ke aiki a fagage iri ɗaya.
Ƙungiyar ta yi amfani da tsare-tsaren haɗin kai daban-daban ciki har da gasar kimiyyar bayanai, abubuwan sa kai, shirye-shiryen zumunci, da taimakon kamfanoni. Duk da waɗannan ƙoƙarin, akwai manyan matsaloli: rashin samun damar bayanai, ƙarancin gwaninta, da kalubalen aiwatarwa na 'mil na ƙarshe'. Hanyar tushen dandamali tana magance waɗannan iyakokin ta hanyar ƙirƙirar mafita masu maimaitawa, masu girma.
Mahimman Fahimta
- Ayyukan AI da aka keɓance suna da iyakataccen girma da tasiri
- Akwai tsarin gama gari a cikin matsalolin kyautatawa waɗanda za a iya sanya su dandamali
- Bukatu na buɗe ido suna ba da damar raba albarkatu da canja wurin ilimi
- Haɗin gwiwar masu ruwa da tsaki yana da mahimmanci don tasiri mai dorewa
2. Tsarin Matsaloli a AI Don Kyautatawa
2.1 Sarrafa Harshe Na Halitta Don Rahotannin Ci Gaba
Ƙungiyoyin ci gaba na ƙasa da ƙasa suna samar da ɗimbin rahotanni na rubutu waɗanda ba a tsara su ba waɗanda ke rubuta ci gaban aikin, kalubale, da sakamako. Binciken waɗannan takaddun da hannu yana ɗaukar lokaci kuma sau da yawa yana rasa fahimta mai mahimmanci. Dandamalin NLP na iya sarrafa cire mahimman bayanai ta atomatik, gano jigogi masu tasowa, da bin diddigin ci gaba akan Manufofin Ci Gaba Mai Dorewa (SDGs).
2.2 Ƙididdiga Na Dalili Don Marasa Ƙarfi
Ƙungiyoyin hidimar zamantakewa suna buƙatar fahimtar sakamakon tasirin shiga tsakani akan ƙungiyoyin da ba su da ƙarfi. Nazarin lura na al'ada sau da yawa yana fama da sauye-sauyen rikicewa da son zuciya. Hanyoyin ƙididdiga na dalili, gami da daidaitawar maki da sauye-sauyen kayan aiki, na iya ba da ƙima mai ƙarfi na ingancin shiga tsakani.
2.3 Rarrabewa Mai Sanin Nuna Bambanci
Yanke shawara na rabo a cikin ayyukan zamantakewa dole ne ya zama mai adalci kuma ba shi da son zuciya. Daidaitattun samfuran injin koyo na iya ci gaba ko haɓaka son zuciya na yau da kullun. Dabarun rarrabawa masu sanin nuna bambanci suna tabbatar da cewa algorithms na rabon albarkatu ba sa cutar da ƙungiyoyin da aka kare yayin kiyaye daidaiton hasashe.
3. Aiwatar da Fasaha
3.1 Tushen Lissafi
Aiwatar da fasaha ta dogara ne akan ra'ayoyin koyo na inji da yawa. Don ƙididdiga na dalili, muna amfani da tsarin sakamako mai yuwuwa:
Bari $Y_i(1)$ da $Y_i(0)$ su wakilci sakamako mai yuwuwa na naúrar $i$ a ƙarƙashin magani da sarrafawa, bi da bi. Tasirin magani na matsakaita (ATE) an ayyana shi kamar haka:
$$\text{ATE} = \mathbb{E}[Y_i(1) - Y_i(0)]$$
Don rarrabawa mai adalci, muna aiwatar da ƙayyadaddun daidaiton alƙaluma. Bari $\hat{Y}$ ya zama sakamakon da aka annabta kuma $A$ ya zama sifa mai kariya. Daidaiton alƙaluma yana buƙatar:
$$P(\hat{Y} = 1 | A = a) = P(\hat{Y} = 1 | A = b) \quad \forall a, b$$
3.2 Sakamakon Gwaji
Gwaje-gwajenmu sun nuna ingancin hanyoyin tushen dandamali a fagage da yawa:
Ayyukan Dandamalin NLP
Dandamalin NLP ya sami daidaito 92% a cikin rarraba rahotannin ci gaba ta rukunin SDG, yana rage lokacin sarrafa hannu da 78%. Tsarin ya sarrafa takaddun fiye da 50,000 daga ƙungiyoyin ƙasa da ƙasa 15.
Tabbatar da Ƙididdiga Na Dalili
A cikin gwajin da aka yi wa bazuwar tare da hukumar hidimar zamantakewa, dandamalin mu na ƙididdiga na dalili ya gano ingantaccen shiga tsakani da daidaito 85%, idan aka kwatanta da 62% na hanyoyin gargajiya.
Ma'aunin Adalci
Mai rarrabawa mai sanin nuna bambanci ya rage bambancin alƙaluma da 94% yayin da yake kiyaye 91% na ainihin daidaiton hasashe a cikin ayyukan rabon albarkatu.
3.3 Aiwatar da Lambar
A ƙasa akwai sauƙaƙan aiwatar da mai rarrabawa mai sanin nuna bambanci:
import numpy as np
from sklearn.linear_model import LogisticRegression
from fairlearn.reductions import ExponentiatedGradient, DemographicParity
class FairSocialClassifier:
def __init__(self):
self.base_estimator = LogisticRegression()
self.constraint = DemographicParity()
self.model = ExponentiatedGradient(
self.base_estimator,
self.constraint
)
def fit(self, X, y, sensitive_features):
self.model.fit(X, y, sensitive_features=sensitive_features)
def predict(self, X):
return self.model.predict(X)
# Misalin amfani
classifier = FairSocialClassifier()
classifier.fit(X_train, y_train, sensitive_features=A_train)
predictions = classifier.predict(X_test)
4. Aikace-aikace da Jagorori Na Gaba
Hanyar dandamali tana nuna alamar alama don haɓaka tasirin AI a fagage da yawa. Jagororin gaba sun haɗa da:
- Canja wurin koyo na fage daban-daban: Ƙirƙirar samfuran da za su iya canja wurin fahimta zuwa fagage na kyautatawa daban-daban
- Koyo na tarayya: Ba da damar horar da samfuri na haɗin gwiwa ba tare da raba bayanai masu mahimmanci ba
- Binciken adalci ta atomatik: Gina kayan aiki don ci gaba da saka idanu kan adalcin algorithm
- Haɗin AI mai bayyanawa: Sanya yanke shawara na samfuri fassara ga ma'aikatan zamantakewa da masu tsara manufofi
Fasahohin da ke tasowa kamar gine-ginen transformer da hanyoyin sadarwar jijiyoyin zane suna ba da sabbin dama don fahimtar hadaddun tsarin zamantakewa. Haɗin waɗannan fasahohin cikin buɗaɗɗen dandamali zai ƙara haɓaka iyawarsu.
Bincike Na Asali: Hanyoyin Zuwa Tasirin AI Mai Girma
Canjin daga nunin AI na keɓancewa zuwa mafita na tushen dandamali yana wakiltar wani muhimmin juyin halitta a cikin ƙungiyar AI don kyautatawa. Yin kwatankwacin da nasarar buɗaɗɗen dandamali a wasu fagage, kamar TensorFlow a cikin koyon inji da Hugging Face a cikin NLP, zamu iya gano manyan abubuwan nasara: gine-ginen yanki, cikakkun takaddun bayanai, da ingantaccen yanayin al'umma. Hanyar da aka ba da shawara tana magance iyakokin girma na asali da Chui et al. (2018) suka gano, musamman ƙarancin gwaninta da kalubalen aiwatarwa.
A fasaha, gine-ginen dandamali dole ne ya daidaita gaba ɗaya tare da keɓancewar yanki. Kamar yadda aka nuna a cikin binciken hangen nesa na kwamfuta, hanyoyin canja wurin koyo kamar waɗanda aka fara a ResNet (He et al., 2016) da BERT (Devlin et al., 2018) sun nuna cewa samfuran da aka riga aka horar da su za a iya daidaita su da kyau don ayyuka na musamman. Wannan tsarin yana dacewa kai tsaye ga fagagen kyautatawa, inda za a iya daidaita samfuran asali don binciken rubutu, ƙididdiga na dalili, da daidaitaccen rarrabawa zuwa yanayi daban-daban.
Mai da hankali kan ƙididdiga na dalili yana da mahimmanci musamman. Duk da yake samfurin hasashe ya mamaye aikace-aikacen AI, fahimtar alaƙar dalili yana da mahimmanci don ingantaccen shiga tsakani. Ci gaban kwanan nan a cikin koyon dalili na inji, kamar waɗanda aka tattauna a cikin aikin Pearl (2009) akan zane-zane na dalili da tsarin sakamako mai yuwuwa, suna ba da tushen ka'idar waɗannan aikace-aikacen. Haɗin waɗannan hanyoyin cikin buɗaɗɗen dandamali yana wakiltar wani gagarumin ci gaba.
Kwatanta da dandamali na masana'antu kamar Dandalin AI na Google da Na'urar Koyon Microsoft Azure sun bayyana mahimmancin ƙwarewar mai haɓakawa da iyawar haɗin kai. Dandamali na kyautatawa masu nasara dole ne su ba da fifikon samun dama ga masu amfani marasa fasaha yayin ba da ƙwararrun iyawa ga masana kimiyyar bayanai. Wannan hanyar biyu tana tabbatar da ɗaukar kaya mai faɗi yayin kiyaye ƙwararrun fasaha.
Idan aka duba gaba, haɗuwar dandamalin AI tare da fasahohin da ke tasowa kamar koyo na tarayya (Kairouz et al., 2021) da keɓantawar bambanci za su magance matsalolin da suka shafi keɓancewar bayanai da tsaro a cikin fagagen zamantakewa masu mahimmanci. Waɗannan ci gaban fasaha, haɗe da tsare-tsaren kuɗi masu dorewa da mulkin masu ruwa da tsaki, za su ƙayyade tasirin dogon lokaci na hanyoyin tushen dandamali ga AI don kyautatawa.
5. Nassoshi
- Varshney, K. R., & Mojsilović, A. (2019). Bukatu Na AI Don Kyautatawa: Tsarin Gama Gari A Matsayin Hanyar Zuwa Tasiri Na Gaskiya. arXiv:1905.11519.
- Chui, M., Harrysson, M., Manyika, J., Roberts, R., Chung, R., & Van Heteren, A. (2018). Aiwatar da AI don kyautatawa. Cibiyar Nazarin Duniya ta McKinsey.
- He, K., Zhang, X., Ren, S., & Sun, J. (2016). Koyon saura mai zurfi don gane hoto. Proceedings of the IEEE conference on computer vision and pattern recognition.
- Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Horar da zurfi na bi-directional transformers don fahimtar harshe. arXiv:1810.04805.
- Pearl, J. (2009). Dalili: Samfura, tunani, da ƙididdiga. Jami'ar Cambridge Press.
- Kairouz, P., McMahan, H. B., Avent, B., Bellet, A., Bennis, M., & Bhagoji, A. N. (2021). Ci gaba da buɗe matsaloli a cikin koyon tarayya. Tushen da Trends® a cikin Koyon Injin.
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Gano nets masu adawa. Ci gaba a cikin tsarin bayanai na jijiyoyi.